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• , The aim of this paper is to establish the uniform convergence of the densities of 

^— > ' a sequence of random variables, which are functionals of an underlying Gaussian pro- 

Scess, to a normal density. Precise estimates for the uniform distance are derived by 
, , using the techniques of Malliavin calculus, combined with Stein's method for normal 

approximation. We need to assume some non-degeneracy conditions. First, the study 
is focused on random variables in a fixed Wiener chaos, and later, the results are ex- 
. tended to the uniform convergence of the derivatives of the densities and to the case of 

random vectors in some fixed chaos, which are uniformly non-degenerate in the sense 

■ of Malliavin calculus. Explicit upper bounds for the uniform norm are obtained for 
random variables in the second Wiener chaos, and an application to the convergence 

\ of densities of the least square estimator for the drift parameter in Ornstein-Uhlenbeck 

CO ' processes is discussed. 
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1 Introduction 

There has been a recent interest in studying normal approximations for sequences of multiple 
stochastic integrals. Consider a sequence of multiple stochastic integrals of order q > 2, 
F n = Iq(fn), with variance a 2 > 0, with respect to an isonormal Gaussian process X = 
{X(h),h G $3} associated with a Hilbert space Sj. It was proved by Nualart and Peccati 
[17] and Nualart and Ortiz-Latorre [16] that F n converges in distribution to the normal law 
N(0, a 2 ) as n — > oo if and only if one of the following three equivalent conditions holds: 

(i) lim^oo -Efi 7 ^] = 3<r 4 (convergence of the fourth moments). 

(ii) For all 1 < r < q — 1, f n (g> r / n converges to zero, where ® r denotes the contraction of 
order r (see equation (2.5)). 

(hi) ||£)F n ||? (see definition in Section 2) converges to qa 2 in L 2 (Q) as n tends to infinity. 

A new methodology to study normal approximations and to derive quantitative results 
combining Stein's method with Malliavin calculus was introduced by Nourdin and Peccati 
[10] (see also Nourdin and Peccati [11]). As an illustration of the power of this method, let 
us mention the following estimate for the total variation distance between the law C(F) of 
F = I q (f) and distribution 7 = JV(0, a 2 ), where a 2 = E[F 2 }: 

thvWn-r) < -jW Var (\\ DF \\i) ^ ¥5^^] - 3a 4 . 

This inequality can be used to show the above equivalence (i)-(iii). A recent result of Nourdin 
and Poly [14] says that the convergence in law for a sequence of multiple stochastic integrals 
of order q > 2 is equivalent to the convergence in total variation if the limit is not constant. 
As a consequence, for a sequence F n of nonzero multiple stochastic integrals of order q > 2, 
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the limit in law to is equivalent to the limit of the densities in L X (]R), provided the limit is 
not constant. A multivariate extension of this result has been derived in [9]. 

The aim of this paper is to study the uniform convergence of the densities of a sequence of 
random vectors F n to the normal density using the techniques of Malliavin calculus, combined 
with Stein's method for normal approximation. It is well-known that to guarantee that each 
F n has a density we need to assume that the norm of the Malliavin derivative of F n has 
negative moments. Thus, a natural assumption to obtain uniform convergence of densities 
is to assume uniform boundedness of the negative moments of the corresponding Malliavin 
derivatives. Our first result (Theorem 4.1) says that if F is a multiple stochastic integral of 
order q > 2 such that E[F 2 ] = a 2 and M := E(\\DF\\~ 6 ) < oo, we have 

sup \f F (x) - 0O)| < C^/EIF*] - 3a 4 , (1.1) 

where f F is the density of F, is the density of the normal law N(0, a 2 ) and the constant C 
depends on q, a and M. We can also replace the expression in the right-hand side of (1.1) 

by yVar (||DF|||) . The main idea to prove this result is to express the density of F using 
Malliavin calculus: 

f F (x) = E[l {F>x} q\\DF\\fF}- E[l {F>x} {DF, D(\\DF\\f))^}. 

Then, one can find an estimate of the form (1.1) for the terms E[\ (DF, D(\\DF\\'I ))^\] and 
-E[|g||-DF||^ 2 — a~ 2 |]. On the other hand, taking into account that 

4>(x) = a' 2 E[l {N>x} N], 

it suffices to estimate the difference 

E[1{ F>X }F\ — E[l{ N>x yN], 

which can be done by Stein's method. The estimate (1.1) leads to the uniform conver- 
gence of the densities in the above equivalence of conditions (i) to (iii) if we assume that 
sup n E(\\DF n \\^)<oo. 

This methodology is extended in the paper in several directions. We consider the uniform 
approximation of the mth derivative of the density of F by the corresponding densities 0^ m \ 
in the case of random variables in a fixed chaos of order q > 2. In Theorem 4.4 we obtain an 
inequality similar to (1.1) assuming that E(\\DF\\^) < oo for some > 6m + 6 (Lf J V 1). 
Again the proof is obtained by a combination of Malliavin calculus and the Stein's method. 
Here we need to consider Stein's equation for functions of the form of h(x) = l{ x>a yp(x), 
where p is a polynomial. 

For a d dimensional random vector F = (F 1 , . . . , F d ) whose components are multi- 
ple stochastic integrals of orders 9i, ...,9d, q% > 2, we assume non degeneracy condition 
E[det , y' F p } < oo for all p > 1, where j F = ((DF, , DF)) 1<:i j <d denotes the Malliavin matrix 
of F. Then, for any multi-index (3 = ((3i, . . . ,/3k), 1 < (3% < d, we obtain the estimate (see 
Theorem 5.2) 
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where V is the covariance matrix of F, is the standard d dimensional normal density, 
and dp = Qx dx . As a consequence, we derive the uniform convergence of the densities 

and their derivatives for a sequence of vectors of multiple stochastic integrals, under the the 
assumption sup n E[det 7^] < 00 for all p > 1. A multivariate extension of Stein's method is 
required for noncontinuous functions with polynomial growth (see Proposition 5.10). While 
univariate Stein's equations with nonsmooth test functions have been extensively studied, 
relatively few results are available for the multivariate case, see [1, 2, 7, 13, 18, 19], so this 
result has its own interest. 

We also consider the case of random variables F such that E[F] =0 and E[F 2 ] = a 2 , 
belonging to the Sobolev space 3 2,s for some s > 4. In this case, under a nondegeneracy 
assumption of the form E[\ (DF, — DFL~ 1 F)$ 1 \~ r \\ < 00 for some r > 2, we derive an estimate 
for the uniform distance between the density of F and the density of the normal law A r (0, a 2 ). 

The paper is organized as follows. Section 2 introduces some preliminary results of Gaus- 
sian analysis, Malliavin calculus and Stein's method for normal approximations. Section 
3 is devoted to density formulae with elementary estimates using Malliavin calculus. The 
density formulae themselves are well-known results, but we present explicit formulae with 
useful estimates, such as the Holder continuity and boundedness estimates in theorems 3.1 
and 3.3. The boundedness estimates enable us to prove the L p convergence of the densities 
(see (4.12)). The Holder continuity estimates can be used to provide a short proof for the 
convergence of densities based on a compactness argument, assuming convergence in law (see 
Theorem 6.5). Section 4 proves the convergence of densities of random variables in a fixed 
Wiener chaos, and Section 5 discusses convergence of densities for random vectors. In Section 
6, the convergence of densities for sequences of general centered square integrable random 
variables are studied. 

The main difficulty in the application of the above results is to verify the existence of 
negative moments for the determinant of the Malliavin matrix. We provide explicit sufficient 
conditions for this condition for random variables in the second Wiener chaos in Section 7. As 
an application we derive the uniform convergence of the densities and their derivatives to the 
normal distribution, as time goes to infinity, for the least squares estimator of the parameter 
9 in the Ornstein-Uhlenbeck process: dX t = —9X t dt + '-fdBt, where B = {B t ,t > 0} is a 
standard Brownian motion. Some technical results and proofs are included in Section 8. 

Along this paper, we denote by C (maybe with subindices) a generic constant that might 
depend on quantities such as the order of multiple stochastic integrals q, the order of the 
derivatives m, the variance a 2 or the negative moments of the Malliavin derivative. We 
denote by ||-|| the norm in the space L P (Q). 

2 Preliminaries 

In the first two subsections, we introduce some basic elements of Gaussian analysis and 
Malliavin calculus, for which we refer to [15, 11] for further details. In the last subsection, 
we shall introduce some basic estimates from the univariate Stein's method. 
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2.1 Isonormal Gaussian process and multiple integrals 

Let fj be a real separable Hilbert space (with its inner product and norm denoted by (■, •)- 
and ||-|L, respectively). For any integer q > 1, let fj 0l3 (fj 09 ) be the qth tensor product 
(symmetric tensor product) of fj. Let X = {X(h), h £ Sj} be an isonormal Gaussian process 
associated with the Hilbert space $), defined on a complete probability space (O, J 7 , P). That 
is, X is a centered Gaussian family of random variables such that E[X(h)X(g)] = (h,g)^ for 
all h, g £ F). We assume that the a- field J 7 is generated by X. 

For every integer q > 0, the qth Wiener chaos (denoted by % 9 ) of X is the closed linear 
subspace of L 2 {VL) generated by the random variables {H q (X(h)) : h £ Sj, \\h\\^ = l}, where 
H q is the gth Hermite polynomial recursively defined by H (x) = 1, H\(x) = x and 

H q+l {x) = xH q {x) - qH q _i{x), q > 1. (2.1) 

For every integer q > 1, the mapping I q {h® q ) = H q (X{h)), where = 1, can be extended 
to a linear isometry between $) @q (equipped with norm yfql ||-|L®<i) and % q (equipped with 
L 2 (Q) norm). For q = 0, = IR, and Iq is the identity map. The mapping I q is called the 
multiple stochastic integral of order q. 

It is well-known (Wiener chaos expansion) that L 2 (Q) can be decomposed into the infinite 
orthogonal sum of the spaces l-i q . That is, any random variable F £ L 2 (Q) has the following 
chaos expansion: 

oo 

F = J2 Iq V q ^ ( 2 - 2 ) 

9=0 

where fo = E[F], and f q £ fj 0<? , q > 1, are uniquely determined by F. For every q > we 
denote by J g the orthogonal projection on the gth Wiener chaos % q , so I q (f q ) = J q F. 

Let {e n ,n > 1} be a complete orthonormal basis of fj. Given / £ fj 09 and g £ fj 0p , for 
r = 0, . . . ,p A q the ri/i contraction of / and g is the element of ^®(p+i- 2r ) defined by 

oo 

f® r g= ^2 ^' e *i ® ' ' ' ® ei r)^- ® (9, e h ® • • ■ ® e ir )^® r . (2.3) 

ii,...,t r =l 

Notice that / ® r g is not necessarily symmetric. We denote by /(EVP its symmetrization. 
Moreover, f ®q g = f ® g, and for p = q, f ® q g = (f, g)§® q - For the product of two multiple 
stochastic integrals we have the multiplication formula 

pM / \ / \ 

W)IM = T, r \ r ) \ r ) Wt(/®r9). (2.4) 

In the particular case = L 2 (A,A,fi), where (A, A) is a measurable space and /i is a 
(T-finite and nonatomic measure, one has that $y® q = L 2 (A q , A® q , /i 09 ) and fj 09 is the space 
of symmetric and square-integrable functions on A q . Moreover, for every / £ S) &q , I q {f) 
coincides with the qth multiple Wiener-Ito integral of / with respect to X, and (2.3) can be 
written as 



/ ®r 9 (ti, . . . , t p+q _ 2r ) — / / (tl, • • • , t q _ r , S±, . . . , S r ) (2.5) 



Xg (tl +(? _ r , . . . , t p+q - r , Si, ... , S r ) dfi(si) . . . d/l(s r ). 
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2.2 Malliavin operators 

We introduce some basic facts on Malliavin calculus with respect to the Gaussian process X. 
Let S denote the class of smooth random variables of the form F = f(X(hi), . . . ,X(h n )), 
where hx,...,h n are in Sj, n > 1, and / G C£°(M n ), the set of smooth functions / such 
that / itself and all its partial derivatives have at most polynomial growth. Given F = 
f(X(hi),...,X(h n )) in S, its Malliavin derivative DF is the i^-valued random variable 
given by 

DF = J2^(X(h 1 ),...,X(h n ))h l . 

i=l 1 

The derivative operator D is a closable and unbounded operator on L 2 (Q) taking values in 
L 2 (f2;fj). By iteration one can define higher order derivatives D k F G L 2 (Q; fj 0fc ) . For any 
integer k > and any p > 1 and we denote by 3 k,p the closure of S with respect to the norm 

\\-\\k, P £ iven h T- 

\\ni P =i:E(\\D*F\\ij. 

8=0 

For fc = 0we simply write ||-F||o,p = H-^Hp- F° r an Y V ^ 1 an d ^ > 0, we set 3°°' p = r\k>o^ )k ' p , 
B k '°° = n p >iD fc ' p and D°° = n k > D k ' 00 . 

We denote by 5 (the divergence operator) the adjoint operator of D, which is an un- 
bounded operator from a domain in L 2 (Q;Sj) to L 2 (Q). An element u G L 2 (Q;$)) belongs to 
the domain of 6 if and only if it verifies 

\E[(DF,u)^]\<c u ^/E{F 2 ~] 

for any F G D 1,2 , where c u is a constant depending only on u. In particular, if u G Dom S, 
then S(u) is characterized by the following duality relationship 

E(5(u)F) =E{{DF,u)x) (2.6) 

for any F G D 1 ' 2 . This formula extends to the multiple integral 5 q , that is, for u G Dom S q 
and F G D 9 ' 2 we have 

E(5 q (u)F) = E((D q F,u)^ q ). 

We can factor out a scalar random variable in the divergence in the following sense. Let 
F G D 1 ' 2 and u G Dom 5 such that Fu G L 2 (Q;Sj). Then Fu G Dom 5 and 

6(Fu) = F6(u)-(DF,u) S) , (2.7) 

provided the right-hand side is square integrable. The operators 5 and D have the following 
commutation relationship 

D5(u) = u + 5{Du) (2.8) 

for any u G D 2 ' 2 (ii) (see [15, page 37]). 

The following version of Meyer's inequality (see [15, Proposition 1.5.7]) will be used 
frequently in this paper. Let V be a real separable Hilbert space. We can also introduce 
Sobolev spaces B) k,p {V) of V- valued random variables for p > 1 and integer k > 1. Then, for 
any p > 1 and k > 1, the operator 5 is continuous from D h,p {V ® io) into © fc_1,p (\/). That is, 

IIWII fc _ llP <C^lkll fc , p - (2.9) 
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The operator L defined on the Wiener chaos expansion as L = Ylq*Lo(~ Q)Jq ^ s the m ~ 
finitesimal generator of the Ornstein-Uhlenbeck semigroup T t = Y^q*Lo e ~ qt Jq- Its domain in 
L 2 (tt) is 

Dom L = |f e L 2 (tt) :j>2q 2 \\J q F\\l < ooj = D 2 ' 2 . 

The relation between the operators D, S and L is explained in the following formula (see [15, 
Proposition 1.4.3]). For F E L 2 (£l), F E Dom L if and only if F E Dom(5D) (i.e., F E D 1 ' 2 
and DF E Dom 5), and in this case 

5DF = -LF. (2.10) 

For any F E L 2 (Q), we define L~ X F = — Yl'qLi Q~ 1 Jq(F)- The operator L~ l is called the 
pseudo-inverse of L. Indeed, for any F E L 2 (Q), we have that L~ l F E Dom L, and 

LL~ 1 F = L~ 1 LF = F - E[F). 

We list here some properties of multiple integrals which will be used in Section 4. Fix q > 1 
and let / E We have I q (f) = S^f) and DI q (f) = ql q -i(f), and hence /,(/) E D°°- 2 . 

The multiple stochastic integral I g (f) satisfies hypercontractivity property: 

\\I q (f)\\ p <C q , p \\I q (f)\\ 2 forany P G[2,oo). (2.11) 

This easily implies that I g (f) E D°° and for any 1 < k < q and p > 2, 

||/ 9 (/)|| felP <C ? , fe>p ||/ 9 (/)|| 2 . 

As a consequence, for any F E ®1 = {Hi, we have 

||^||fc )P < Cq,k,P \\ F \\2 ■ (2.12) 
For any random variable F in the chaos of order q > 2, we have (see [11], Equation (5.2.7)) 



Ivar (||DF|| 2 ) < q —l {E[F A } - (E[F 2 }) 2 ) < (q - l)Var (||DF|| 2 ) . (2.13) 
q oq 



In the case where fj is L 2 (A, A, /i), for an integrable random variable F = Ylq*Lo Iq(fq) e 
E! 1,2 , its derivative can be represented as an element in of L 2 (A x Q) given by 



AF=^g/,(/,(-,t)), t e A. 



9=1 

2.3 Stein's method of normal approximation 

We shall now give a brief account of Stein's method of univariate normal approximation and 
its connection with Malliavin calculus. For a more detailed exposition we refer to [1, 11, 20]. 

Let F be an arbitrary random variable and let N be a iV(0, a 2 ) distributed random 
variable, where a 2 > 0. Consider the distance between the law of F and the law of iV given 
by 

d H (FN) = sup \E[h(F) - h(N)}\ (2.14) 
hen 
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for a class of functions % such that E[h(F)] and E[h(N)] are well-defined for h EH. Notice 
first the following fact (which is usually referred as Stein's lemma): a random variable N 
is iV(0,cr 2 ) distributed if and only if E[a 2 f'(N) — Nf(N)] = for all absolutely continuous 
functions / such that E[\f'(N)\] < oo. This suggests that the distance of E[a 2 f'(F) -Ff(F)} 
from zero may quantify the distance between the law of F and the law of N. To see this, for 
each function h such that £'[|/i(A r )|] < oo, Stein [20] introduced the Stein's equation: 

f\x)--J{x) = h{x)-E[h{N)\ (2.15) 

for all For a random variable F such that i?[|/i(.F)|] < oo, any solution fh to Equation 

(2.15) verifies 

- 2 E[a 2 f h {F) - Ff h (F)} = E[h(F) - h(N)), (2.16) 
and the distance defined in (2.14) can be written as 

d n (F,N) = -isup \E[a 2 f' h (F)-Ff h (F)]\ . (2.17) 
°~ hen 

The unique solution to (2.15) verifying lim^-too e~ x2 ^ 2cr2 ^ f (x) = is 

f h (x) = e x2 '^ f {%) - E[h{N)]}e-y 2 /^dy. (2.18) 

J — oo 

From (2.17) and (2.18), one can get bounds for probability distances like the total variation 
distance, where we let "H consist of all indicator functions of measurable sets, Kolmogorov 
distance, where we consider all the half-line indicator functions and Wasserstein distance, 
where we take % to be the set of all Lipschitz-continuous functions with Lipschitz-constant 
equal to 1. 

In the present paper, we shall consider the case when h : IR — )■ M is given by h(x) = 
l{x>z}Hk(x) for any integer k > 1 and z G IR, where Hk(x) is the kth Hermite polynomial. 
More generally, we have the following lemma whose proof can be found in the Appendix. 

Lemma 2.1 Suppose \h(x)\ < a\x\ k + b for some integer k > and some nonnegative 
numbers a,b. Then, the solution fh to the Stein's equation (2.15) given by (2.18) satisfies 

k 

\f h {x)\<aC k Y,° k - l \4 + tt 

for all where Ck is a constant depending only on k. 

Nourdin and Peccati [10, 11] combined Stein's method with Malliavin calculus to estimate 
the distance between the distributions of regular functionals of an isonormal Gaussian process 
and the normal distribution N(0,a 2 ). The basic ingredient is the following integration by 
parts formula. For F e D 1 ' 2 with E[F] = and any function / e C 1 such that E[\f'(F)\] < 
oo, using (2.10) and (2.6) we have 

E[Ff(F)} = E[LL~ 1 Ff(F)] = E[—5DL~ 1 Ff(F)] 

= E[(-DL- 1 F,Df(F))] = E[f'(F)(-DL- 1 F,DF)^}. 

Then, it follows that 

E[a 2 f'(F) - Ff(F)] = E[f'(F)(a 2 - (DF, -DL^F)^)]. (2.19) 
Combining Equation (2.19) with (2.16) and Lemma 2.1 we obtain the following result. 
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Lemma 2.2 Suppose h : R — >■ M verifies \h(x)\ < a\x\ k + 6 /or some a, 6 > and some 
integer k > 0. Lei iV ~ iV(0,a 2 ) and /ei F G D 1,2fc wit/i ||-F|| 2fc < co" / or some c > 0. Then 
there exists a constant Ck, c depending only on k and c such that 

\E[h(F) - h{N)] \ < o~\aC Kc a k + 46] a 2 - (DF, -DL^F) 



Proof. From (2.16), (2.19) and Lemma (2.1), it suffices to notice that Yli=o ak % \F^ 

Etoll^ll 2 ,^<c^ fc - 
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3 Density formulae 

In this section, we present explicit formulae for the density of a random variable and its 
derivatives, using the techniques of Malliavin calculus. 

3.1 Density formulae 

We shall present two explicit formulae for the density of a random variable, with estimates 
of its uniform and Holder norms. 



Theorem 3.1 Let F G D 2 - s such that E[\F\ 2p ] < oo and E[\\DF\\~ zr ] < oo forp,r,s > 1 



-2n 



satisfying 



1 + 1 + 1 

p r s 



1. Denote 



w = \\DF\\l , u = w~ l DF. 



Then u G D 1,p ' with p' = and F has a density given by 

f F {x)=E[l {F>x} 6(u)]. 
Furthermore, f F (x) is bounded and Holder continuous of order -, that is 

f F {x)<C p \\w-\\\F\\ 2s (l/\{\x\- 2 \\F\\l p )), 



\f F (x)-f F (y)\<C p \\w 



2,s \ x - y\ 



for any x, y G M., where C p is a constant depending only on p. 
Proof. Note that 

Du = w~ 1 D 2 F - 2w~ 2 (D 2 F ® x DF) ® DF. 
Applying Meyer's inequality (2.9) and Holder's inequality we have 

II* («)!!„ < C p \\u\\ hp ,<C p (\\u\\ pf +\\Du\\ p> ) 

1 \\D 2 F\ 



< CpiWw" 1 WDFW^l, 



w 



< ?>c p \\w~ l \ 



\DF\ 



\D 2 F\ 



(3.1) 

(3.2) 
(3.3) 



(3.4) 
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Then u G D 1 ^' and the density formula (3.1) holds (see, for instance, Nualart [15, Proposition 
2.1.1]). From = and Holder's inequality it follows that 

\E [1 {F>X} 5 («)] | < P (\F\ > \x\f P \\5 («) \\ p , < (l A (\x\- 2p ||F|||)) 1 ||£ (u)|| p , . (3.5) 

Then (3.2) follows from (3.5) and (3.4). 

Finally, for x < y G R, noticing that 1{f>x} — 1{f>^} = 1{s<f<j/}) we have 



L/>0*0-My)|< (S[W<„}]) F ||5 



Applying (3.2) and (3.4) with the fact that E[l{ x< F< y }] = J /f (z) d-z one gets (3.3). ■ 

With the exact proof of [15, Propositions 2.1.1], one can prove the following slightly more 
general result. 

Proposition 3.2 Let F G D 1,p and h : — >■ Sj, and suppose that (DF,h)^ ^ a.s. and 
G 3 1,q (Sj) for some p, q > 1. Then the law of F has a density given by 



(DF,h)f, 

h 



f f (x) = E 



l{F>x}8 



(DF, h) s 



(3.6) 



Our next goal is to take h to be — DL 1 F in formula (3.6) and get a result similar to 
Theorem 3.1. First, to get a sufficient condition for ^ D f^L-^F) e ^ >1 ' P ^ or some P' > 1) 
we need some technical estimates on DL~ 1 F and D 2 L~ 1 F. Estimates of this type have been 
obtained by Nourdin, Peccati and Reinert [12] (see also Nourdin and Peccati's book [11, 
Lemma 5.3.8]), when proving an infinite-dimensional Poincare inequality. More precisely, by 
using Mehler's formula, they proved that for any p > 1, if F G D 2,p , then 

E[\\DL-'F\\l\<E[\\DF\\^. (3.7) 
E[\\D 2 L~ l F\\ P op ] < 2- p E[\\D 2 F\\ P op l (3.8) 

where H-D 2 -^!^ denotes the operator norm of the Hilbert-Schmidt operator from Sj to fj : 
f i — y f &>i D 2 F. Furthermore, the operator norm ||D 2 F|| satisfies the following "random 
contraction inequality" 

\\D 2 F\\l < \\D 2 F ® 1 D 2 F\\ 2 ^ 2 < \\D 2 F\\^ 2 . (3.9) 
The next proposition gives a density formula with estimates similar to Theorem 3.1. Let 

w = (DF, -DL^F)^ , u = -w^DL^F. 

Proposition 3.3 Let F G D 2,s , i?[|F| 2p ] < oo and suppose that E[\w\~ r ] < oo, where p > 1, 
r > 2, s > 3 satisfy ~ + ~ + f = 1- Then u G D 1 ^ with p' = and the law of F has a 
density given by 

f F (x)=E[l {F>x} 5(u)]. (3.10) 
Furthermore, fp (x) is bounded and Holder continuous of order ^, that is 

fF(x)<K {lA(\xr 2 \\F\\ 2 2p )y (3.11) 

\f F (x)-f F (y)\<K 1 + "\x-y\ 1 P (3.12) 

for any x, y G R, where K = C p ||w _1 || r \\F\\ 2 s (||ifj -1 || r ||-D-F|| 2 + 1), and C p depends only on 
p. 
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Proof. Note that Dw = —D 2 F ® 1 DL~ X F — DF <g>i D 2 L~ 1 F. Then, applying (3.7) and (3.8) 
we obtain 



\\Dw\\s < (1 + 2" 



\D F\ 



op 



\DF\ 



(3.13) 



From u = —w l DL 1 F we get Du = —w l D 2 L l F + w 2 Dw <E> DL l F. Then, usinj; 
(3.7)-(3.9) we have for t > satisfying ^7 = 7 + 7, 



< Ik'" 1 ! 



\DF\ 



t ■ 



and 



\Du\\ P > < 



< Ww' 1 



w- l \\D 2 L- l F\ 
\D 2 F\\. 



ft®?) 



\w~ 2 \ 



ur 2 \\Dw\\^ \\DL~ l F\ 
\Dw\\. \\DFL,. 



Noticing that ||D 2 F|| t < ||-D 2 -F|| S because t < s, and applying Meyer's inequality (2.9) with 
(3.13) and (3.9) we obtain 

\\5(u)\\ p ,<C p \\u\\ ljp/ <K . (3.14) 

Then u G D 1 ^' and the density formula (3.10) holds. As in the proof of Theorem 3.1, (3.11) 
and (3.12) follow from (3.14) and 

\E [1 {F>X} 5 («)] I < P (\F\ > \x\)7 \\5 (u)\\ p , < (l A (\x\- 2 \\F\\ 2 2p )) \\S (u)\\ p , , 
\f F (x)-f F (y)\<(E[l {x<F < y} })*\\6(u)\\ pl . 



3.2 Derivatives of the density 

Next we present a formula for the derivatives of the density function, under additional condi- 
tions. A sequence of recursively defined random variables given by Go = 1 and Gk+i = 5(Gku) 
where u is an fj- valued process, plays an essential role in the formula. The following technical 
lemma gives an explicit formula for the sequence Gk, relating it to Hermite polynomials. To 
simplify the notation, for an ij-valued random variable u, we denote 

6 U = S(u), D U G = (DG, u)„ , D k u G = (D (D k u ~ l G) , u)^ . (3.15) 

Recall Hk(x) denotes the fcth Hermite polynomial. For A > and x G K, we define the 
generalized fcth Hermite polynomial as 

H k (X,x) = X^H k (^=). (3.16) 

From the property H' k (x) = kHk-i{x) it follows by induction that the fcth Hermite polynomi- 
als has the form Hk(x) = J2o<i<[k/2\ c k,i% k ~ 2 \ where we denote by \_k/2\ the largest integer 
less than or equal to k/2. Then (3.16) implies 

H k {\,x)= Yl c k>i x k - 2i \\ (3-17) 

0<i< \_k/2\ 
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Lemma 3.4 Fix an integer m > 1 and a number p > m. Suppose u G 3 m ' p (Sj). We define 
recursively a sequence {Gfc}^ by Gq = 1 and G^+i = 5(G k u). Then, these variables are 
well-defined and for k — 1, 2, . . . , m, G k G D' m_fe 't and 

G k = H k (DJ u ,5 u )+T k , (3.18) 

where we denote by T k the higher order derivative terms which can be defined recursively as 
follows: T\ = T2 = and for k > 2, 

T k+1 = 5 u T k - D u T k - d x H k (DJ u , 5 U )D 2 J U . (3.19) 
The following remark is proved in the Appendix. 
Remark 3.5 From (3.19) we can deduce that for k > 3 

T k = £ a i0>iu ... >ih _X° {DJuT {DXT 2 ■ ■ ■ {D^Xy*- 1 , (3.20) 

(io,...,ife_i)e Jk 

where the coefficients (H ,ii,...,ik-i are rea ^ numbers and J k is the set of multi-indices (io, ii, . . . , i k - 
N k satisfying the following three conditions 

k-l fc-1 , . 

(a) io + ^jij < k - 1; (6) i 2 H h «fc-i > 1; (c) < [—^— J. 

3=1 3=1 

From (b) we see that every term in T k contains at least one factor of the form Dl5 u with 
some j > 2. We shall show this type of factors will converge to zero. For this reason we call 
these terms high order terms. 

Proof of Lemma 3.4- First, we prove by induction on k that the above sequence G k is 
well-defined and G k G D m_fc 'fe. Suppose first that k — 1. Then, Meyer's inequality implies 
that Gi = 5 U G D m ~ 1,p . Assume now that for k < m — 1, G k G D m_fc 'fe. Then it follows from 
Meyer's and Holder's inequalities (see [15, Proposition 1.5.6]) that 

||G fc+ i|| m _ fc _i.p < C mtP \\G k u\\ m _ k ^ < C' \\G k \\ m _ k E \\u\\ m - k:P < 00. 

Let us now show, by induction, the decomposition (3.18). When k — 1 (3.18) is true because 
G\ = 5 U and T\ = 0. Assume now (3.18) holds for k < m — 1. Noticing that d x H k (X,x) = 
kH k _i(X,x) (since H' k (x) = kH k _i(x)), we get 

D u H k (D u 5 u , 8 U ) = kH k ^i(D u 5 u , 5 U )D U 5 U + d x H k (D u 5 u , 5 U )D 2 J U . 

Hence, applying the operator D u to both sides of (3.18), 

D u G k = kH k _i(D u b~ u , 5 U )D U 5 U + T k+1 , 

where 

f k+1 = D u T k + d\H k (D u 5 u , 5 U )D 2 J U . (3.21) 
From the definition of G k+ i and using (2.7) we obtain 

G k+ i = 5{uG k ) = G k 5 u — D u G k 
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= $uHk(D u 5 u , 5 U ) + 5 u T k — kHk-i(D u S u , S U )D U 5 U — T k+1 . 

Note that H k+ \(x) = xH k (x) — kH k -i(x) implies xH k (X,x) — kXH k -i(X,x) = H k+ i(X,x). 
Hence, 

Gk+i = Hk+i(D u 5 u , 5 U ) + S u T k — Tk+i- 

The term T k +i = 5 u T k — T k +i has the form given in (3.19). This completes the proof. ■ 

Now we are ready to present some formulae for the derivatives of the density function 
under certain sufficient conditions on the random variable F. For a random variable F in 
D 1,2 and for any /3 > 1 we are going to use the notation 



M P (F)= [E[\\DF\\- p ])\ (3.22) 



Proposition 3.6 Fix an integer m > 1. Let F be a random variable in D m+2,0 ° such that 
M P {F) < oo for some (3 > 3m + 3([f J V 1). Denote w = \\DF\\\ and u = ^f. Then, 
u G D m+1,p (fj) for some p > 1, and the random variables {Gk}™^ introduced in Lemma 3.4 
are well-defined. Under these assumptions, F has a density f of class C m with derivatives 
given by 

ff\x) = (-l) k E[l {F>x} G k+1 \ (3.23) 

for k = 1 , . . . , m . 

Proof. It is enough to show that {G k Y k n ^ are well-defined, since it follows from [15, Exercise 
2.1.4] that the fcth derivative of the density of F is given by (3.23). To do this we will show 
that G k defined in (3.18) are in L l (Vt) for all k = 1, . . . , m + 1. From (3.18) we can write 

E[\G k \]<E[\H k (DJ u ,5 u )\}+E[\T k \}. 

Recall the explicit expression of H k (X,x) in (3.17). Since (3 > 3(m + 1), we can choose 
r < f , r\ < | such that 

k-2i i 3 (k - 2i) Qi _ 3k 
1 " r + n > j9 + J ~ J' 

for any < i < \k/2\ and 1 < k < rn+ 1. Then, applying Holder's inequality with (3.17), 
(8.11) and (8.12) we have 

E[\H k (D u 8 u ,8 u )\] < C k W 5 Xo 2i IPAIi;, < oo. 

0<i< |fc/2j 

To prove that E [\T k \] < oo, applying Holder's inequality to the expression (3.20) and 
choosing rj > for < j < k — 1 such that 

fe-i . „ . fc-i 



i > i° + y k > ^£ + y + 3 ^ 

— r „ ^— ^ r ■ R ^-^ 



we obtain that, (assuming k > 3, otherwise 7*. = 0) 

fc-i 

£[|r fc |]<c £ II^Cnil^AlK- 

(i ,...,jfe)eJ fc i=i 
13 



Due to (8.11) and (8.12), this expression is finite, provided rj < for < j < k — 1. We 

can choose (rj, < j < k — 1) satisfying the above conditions because (3 > 3(k — 1) + 3|_^pJ 
for all 1 < k < m + 1, and from properties (a) and (c) of in Remark 3.5 we have 



3^o 





k-l 



^ (3j + 3)»j < 3(fc-l) + 3LVJ 



/3 



/3 



This completes the proof. 



Example 3.7 Consider a random variable in the first Wiener chaos N = I\(h), where G 
with ||/i||j5 = cr. Then N has the normal distribution N ~ A^O, a 2 ) with density denoted by 
<p(x). Clearly \\DN\\~ =a, u = 4, S u = 4 and D U 5 U = 4. T/ien 



^(^2, ^r) and from 



(3.23) we obtain the formula 



■T) 



-1YE 



l{N>x}Hk+l 



1 N 

^2' ^ 



(3.24) 



which can also be obtained by analytic arguments. 



4 Random variables in the qth Wiener chaos 

In this section we establish our main results on uniform estimates and uniform convergence 
of densities and their derivatives. We shall deal first with the convergence of densities and 
later we consider their derivatives. 

4.1 Uniform estimates of densities 

Let F = I q (f) for some / G Sj Gq and q > 2. To simplify the notation, along this section we 
denote 

w = \\DF\\l, u = w~ x DF. 
Note that LF = —qF and using (2.7) and (2.10) we can write 

6 U = 5(u) = qFw- 1 - (Dw-\ DF)^ . (4.1) 

Theorem 4.1 Let F = I q (f), q > 2, for some f G S) Gq be a random variable in the qth 
Wiener chaos with E[F 2 ] = a 2 . Assume that Mq(F) < oo, where M$(F) is defined in 
(3.22). Let (p(x) be the density of N ~ iV(0,<7 2 ). Then F has a density fp(x) given by (3.1). 
Furthermore, 

sup \f F (x) - cj)(x)\ < C^E[F*} - 3a 4 , (4.2) 

where the constant C has the form C = C q (<t _1 M 6 (F) 2 + M 6 (F) 3 + cr~ 3 ) and C q depends 
only on q. 

We begin with a lemma giving an estimate for the contraction D h F®xD l F with k + l > 3. 

Lemma 4.2 Let F = I q (f) be a random variable in the qth Wiener chaos with E[F 2 ] = a 2 . 
Then for any integers k > I > 1 satisfying k + 1 > 3, there exists a constant Ck,i, q depending 
only on k, I, q such that 

\\D k F ®! £>'F|| 2 < C kM \\qa 2 - \\DF\Q 2 . (4.3) 
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Proof. Note that D k F = q(q - 1) • • • (q - k + l)I q _ k (f). Applying (2.4), we get 
D k F® x D l F = q 2 (q-l) 2 (q -1 + l) 2 (q -/)••■ (q - k + 1) 

q—k 

x > r! 



r=0 

Taking into account the orthogonality of multiple integrals of different orders, we obtain 

\ i 



fo'r 



'^ (fe+i - 2)J (q - l)\ 2 (q - k)\ 2 

x e h2 ( g 2 ( V z ) 2 ( 2 ? - k - 1 - ^ ii/Sr+i/iiw-* • (4-4) 

Applying (4.4) with /c = / = 1, we obtain 

£[||Z>F||J] = E[| J DF® 1J DF| 2 ] (4.5) 

= 9 4 J2 r]2 ( q ~ 1 ) (2?-2-2r)!||/® r+1 /||J, 



\$j<$2q- 



2-2r 



r=0 

9-2 , ix4 



? 4 E r ' 2 ( g r x ) ( 2 <? - 2 - 2 ^ ll/sw||;U-— + <? 2, ? !2 

r=0 ^ ' 



Taking into account that a 2 = E[F 2 ] = q\ ||/||«® g , we obtain that for any k + I > 3, there 
exists a constant Ck,i, q such that 

E^F®, D l F\\l, (k+l _, } ] < Cl, q E[\\DF\\l - q 2 a% 

Meanwhile, it follows from = q \\f\\^ g = qcr 2 that 

^OI^IIJ - <l 2 A = m\DF\\% - 2^ 2 \\DF\\l + gV] = E[{\\DF\\% - qa 2 ) 2 }. (4.6) 
Combining (4.4), (4.5) and (4.6) we have 

E[\\D k F ®! D l F\\ 2 mk+l _ 2) ] < C 2 kM E[(\\DF\\l - qa 2 ) 2 ], 
which completes the proof. ■ 

Proof of Theorem 4.1. It follows from Theorem 3.1 that F admits a density f F (x) = 
E \l{ F>x }5 (u)] . By (3.24) with k — 1 we can write <f>(x) = -^E[l^N >x yN]. Then, using (4.1), 
for all x 6 M we obtain 



f F (x) - <f>(x) = E [1 {F>X} 5 («)] - a~ 2 E[l {N>x} N] 
w 



E[1 {F>X} (F(^ - a" 2 ) - (Dw~\ DF)^)} + o~ 2 E [Fl {F>x} - Nl {N>x} ] 



= A 1 + A 2 . (4.7) 
For the first term A\, Holder's inequality implies 

l^il = \E[l {F>xy (F(?--o-~ 2 )-(Div-\DF)J} 
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< a- 2 E [\Fw^(w - qa 2 )\] + 2E[w~'i \\D 2 F® X DF\ 



^ -2 II -111 II 771II II 2|| 

< cr \\w || 3 \\P || 3 \\w - qa || 3 



_ 3 
W 2 



\D 2 F®i DF\ 



Note that (2.12) implies 



\w — qa 2 \\ < C \\w — qa' 



and ||-F|| 3 < C \\F\\ 2 = Co . Combining these estimates with (4.3) we obtain 



\M\ < C(o~ l \\w- l \ 



\w 



\w - qa \\ 2 



(4- 



For the second term A2, applying Lemma 2.2 to the function h(z) = zl{ z>x y, which 
satisfies \h(z)\ < \z\, we have 



\A 2 \ = a~ 2 \E [F1 {F>X} - N1 {N>X} ] 
o 2 - (DF, -DL~ l F) 



< Co 



Combining (4.7) with (4.8)-(4.9) we obtain 



< Co- i \\qo z -w\ 



(4.9) 



1 1 — 

sup \Jf{x) — 4>{x)\ < C(a~ l it; - " 1 + ku _1 ^ + a~ 3 ) \\w — qa 



Then (4.2) follows from (2.13). This completes the proof. ■ 

Using the estimates shown in Theorem 4.1 we can deduce the following uniform conver- 
gence and convergence in L p of densities for a sequence of random variables in a fixed qth 
Wiener chaos. 

Corollary 4.3 Let {F n } neN be a sequence of random variables in the qth Wiener chaos with 
q > 2. Set a 2 = E[F 2 } and assume that lim^oo a 2 = a 2 ,0<5<a 2 <K for all n, 
lim^oo E[F*} = 3d 4 and 

M := sup {E[\\DF n \\^]) 1/6 < 00. (4.10) 

n 

Let 4>(x) be the density of the law N(0,a 2 ). Then, each F n admits a density fp n G C(M) and 
there exists a constant C depending only on q, a, S and M such that 



sup |/j, B (x) - <f>{x)\ < C (\E[F$] - 3^ + \a n - a\) 



Furthermore, for any p > 1 and a G (h,p), 



(4-11) 



r 4|2 



0V, — (7 



\\f Fn -<P\\ LPm <C(\E[F^]-3a 4 n 
where C is a constant depending on q, a, M,p, a and K . 
Proof. Let (j) n (x) be the density of N(0,a 2 ). Then Theorem 4.1 implies that 



(4.12) 



sup \f Fn (x) - <t> n {x)\ < C \E[F£] - 3a^ 
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On the other hand, if N n ~ N(0, a 2 ), it is easy to see that 

sup \4> n (x) - 4>(x)\ <C\a n -a\. 

Then (4.11) follows from triangle inequality. To show (4.12), first notice that (3.2) implies 

f Fn (x)<c(iA\ x r 2 ). 

Therefore, if a > \ the function (f Fn (x) + 4>(x)) a is integrable. Then, (4.12) follows from 
(4.11) and the inequality 

\f Fn ( X ) - 0(x)r < i/f„(x) - <f>(x)r a (f Fn (x) + <K*)r. 



4.2 Uniform estimation of derivatives of densities 

In this subsection, we establish the uniform convergence for derivatives of densities of random 
variables to a normal distribution. We begin with the following theorem which estimates the 
uniform distance between the derivatives of the densities of a random variable F in the gth 
Wiener chaos and the normal law N(0, E[F 2 ]). 

Theorem 4.4 Let m > 1 be an integer. Let F be a random variable in the qth Wiener 
chaos, q>2, with E[F 2 } = a 2 and Mp := Mp{F) < oo for some (3 > 6m + 6([f J VI) (Recall 
the definition of Mp(F) in (3. 22) J. Let <p(x) be the density of N ~ N(0,a 2 ). Then F has a 
density f F {x) E C m (M) with derivatives given by (3.23). Moreover, for any k — 1, . . . ,m 



sup 



fP{x) - <P {k \x) < o-- k ^C^E[F±] - 3a 2 , 



where the constant C depends on q, (3, m, a and Mp with polynomial growth in o and Mp. 

To prove Theorem 4.4, we need some technical results. Recall the notation we introduced 
in (3.15), where we denote 5 U = S(u), D U 5 U = (DS u ,u)~. 

Lemma 4.5 Let F be a random variable in the qth Wiener chaos with E[F 2 ] = a 2 . Let 

1 1 2 1 

w = \\DF\\fi and u = w DF. 

(i) If Mp(F) < oo for some (3 > 6, then for any 1 < r < -3^ 

\\S U - o-- 2 F\\ r < Co--\Ml V 1) ||ga 2 - w\\ 2 . (4.13) 

(ii) If Mp(F) < oo for some (3 > 12, then for any 1 < r < 

|| AA - <x- 2 || r < Ca~ 2 (Ml V 1) \\qa 2 - w\\ 2 , (4.14) 
where the constant C depends on a. 
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Proof. Recall that 5 U = qFw 1 — Dj^pw 1 . Using Holder's inequality and (8.3) we can write 



\5 u -a- 2 F\\ r < \\a- 2 Fw-\qo a -w)\\ r + \\D DF w~ 1 \\ r 
< (7 (tr- 2 !!^- 1 !!. + (Af| V 1)) \\qa- 



2 w\ 



2 ' 



provided - = - + \. By the hypercontractivity property (2.11) ||F|| 7 < Cg i7 ||F|| 2 for any 
7 > 2. Thus, by Holder's inequality, if \ = - + - 

\\Fw-%< \\FUw-%<C q>J aMl. 

Choosing p such that 2p < (3 we get (4.13). 
We can compute D U 5 U as 

DJ U = qw" 1 + qFiv^DoFW" 1 - v,r l D 2 DF w~ l - w~ l (D 2 F, DF <g> Dw~ l ) . 

Applying Holder's inequality we obtain 

\\D U 5 U - a~ 2 \\ r < \\vo~ 1 [a~ 2 (qa 2 -w) + qFD DF w~ l - D 2 df uj- 1 ] \\ r 
< cr~ 2 || 1| ||gcr 2 - w|| 2 + C CT ||w _1 || p (||£> df w _1 || s + ||.D|, F w _1 || s ) , 



if i > - + K Then, using (8.3) and (8.4) with k = 2 and assuming that s < and that 
2p < (3 we obtain (4.14). ■ 

Proof of Theorem 4.4. Proposition 3.6 implies that f F {x) G C m_1 (M) and for k = 



0, 1, . . . ,m - 1, 



fP(x) = (-l) k E[l {F>x} G k , 



where Go = I and Gk+i = 5{G k u) = G k 5{u) — (DG k ,u)^. From (3.24), 

^ k \x) = (-l) k E[l {N>x} H k+1 (o-- 2 ,o- 2 N)}. 

Then, the identity G k+ i = H k+ i(D u 5 u ,5 u ) + T k+ i (see formula (3.18)), suggests the following 
triangle inequality 

f i F k \x)-^ k \x)\ = \E[l {F>x} G k+1 -l {N>x} H k+1 (a- 2 ,o-- 2 N)}\ 

< \E[l{ F>x yGk+i — l{ F>x }H k+ i(a~ 2 , a~ 2 F)]\ 

+ \E[l {F>x} H k+1 (a~ 2 ,a- 2 F) - l {N>x} H k+1 {<j- 2 ,o- 2 N)}\ 
= Ai + A 2 . 

We first estimate the term A 2 . Note that ||-F|| 2 fc+2 — ^9,fc 11-^112 = Cq,k°~ by the hypercon- 
tractivity property (2.11). Applying Lemma 2.2 with h(z) = l^ z>x jH k+ i(a~ 2 ,a~ 2 z), which 
satisfies \h{z)\ < C k (\z\ k+1 + cr~ fc_1 ), we obtain 



A 2 = \E[h(F) - h(N)}\ 
< C q k a~ 2 \a k + 4a~ 



a 2 - (DF, -DL~ 1 F) i 



< C qAa a- k - 3 \\qa 2 -w\\ 2 , (4.15) 
where in the second inequality we used the fact that (DF, —DL~ 1 F) S 



q 



For the term A±, Lemma 3.4 implies 

A x < E[\H k+1 (DJ u ,5 u ) - H k+1 (a~ 2 ,a~ 2 F)\} + E[\T k+1 \]. 
To proceed with the first term above, applying (3.17) we have 



\H k+1 (DJ u ,5 u ) - H k+1 (a-\a~ 2 F) 

0<i<L(fe+l)/2j 



<V {l) u 6 u ) -[ah) a 



0<i<L(fc+l)/2j 



n Mi I -2 r?\k+l-2i 



(D u 5 u y - a 



(4.16) 



(4.17) 



-2/ 



o<j<fc-i 



\x 



k ~ l -3 \„,\3 



Using the fact that \x — y < C k \x — y \ ^2 
equality and the hypercontractivity property (2.11) we obtain 



1 2/ 1 an d a PPly m g Holder's in- 



E 

< C k E 



5 k u +1 ~ 2i - {a- 2 F) h+1 - 2i \\D u 5 u 



\5 u -a^F\\DM £ N^V^I 



0<j<k-2i 

< C q , k:(T \\5 u - a~ 2 F\\ r \\D u 5 u \\l ) j 

0<3<k-2i 



\k-2i-j —j 
\p u ■ 



(4.18) 



provided 1 > £ + * + k 2 * \ which is implied by 1 > £ + ^ + k -^ L - In order to apply the 

estimates (4.13), (8.12) (with k = 1) and (8.11) we need \ > | + \, \ > ~ and ± > |, 
respectively. These are possible because /3 > 6/c + 6. Then we obtain an estimate of the form 



Similarly, 



8 k u +1 ~ 2i - (a- 2 F) k+1 - 2i \DJ U [ <C q ^a- k {Mf + *Vl)\\q<j 2 -w\ 



(4.19) 



E 

< C q , k)(T E 



a -^F\ k+1 ~ 2i 



(AA 



a 



-2i 



I -2 77^+1-2* 



-2(i-l-j) 



0<j'<i-l 
0<j"<i-l 



(4.20) 



provided !>- + -. In order to apply the estimates (4.14) and (8.12) (with k — 1) we need 



i > | + | and ~ > |, respectively. This implies 



1 7 6 + 6 ? 1 
- + - > + -. 

r s (3 2 



Notice that 6 + 6j < 6i < 3k + 3. So, we need 1 > | + The above r, s and p exist 

because /3 > 6k + 6. Thus, we obtain an estimate of the form 



E 



I -2j7|fc+l-2i 



(AA) 1 - a- 2t 1 < C qM< T^ k - 1 \M^ +3 V l)|| g( r 2 - w\\ 2 . (4.21) 



19 



Combining (4.19) and (4.21) we have 

E[\H k+1 (DJ u ,S u )-H k+1 (a- 2 ,a- 2 F)\] < C qM o- k {Mf + 3 V l)||ga 2 - w\\ 2 . (4.22) 

Applying Holder's inequality to the expression (3.20) we obtain, (assuming k > 2 , oth- 
erwise T k+1 = 0) 

k 




(io,.--,«fe)6J fe+ i 3=1 

where 1 = ^ + ~52j=i 7~- F rom property (b) in Remark 3.5 there is at least one factor of 
the form ||D{5 M || S . with j > 2. We apply the estimate (8.13) to one of these factors, and 
the estimate (8.12) to all the remaining factors. We also use the estimate (8.11) to control 
1 1 (LI I . Notice that 

II u 1 1 ro 

k k 

1 - !° , ^ 3z v^ ij(3j + 3) 1 

ro + ^r i > + ^ + 2' 

and, on the other hand, using properties (a) and (c) in Remark 3.5 

3i * ^- + 3) 1 3fc + 3L|J 1 
^ 2 - 2' 

3=1 

We can choose the r/s satisfying the above properties because > 6k + 6 |_§J , and we obtain 

E \T k+1 \ < C q>kj<T>p (M* k+3lli V 1) \\qa 2 - w\\ 2 . (4.23) 
Combining (4.22) and (4.23) we complete the proof. ■ 

Corollary 4.6 Fix an integer m > 1. Let {F n } neN be a sequence of random variables in the 
qth Wiener chaos with q > 2 and E[F 2 ] = a 2 . Assume lim^oo a n = a, < 5 < a 2 < K for 
all n, lim^oo E[F^] = 3cr 4 and 

M:=sup(E[|| J DF n ||/]) ? < oo (4.24) 

for some > 6(m) + 6(|_ttJ V 1). Let 4>{x) be the density of N(0, a 2 ). Then, each F n admits 
a probability density function fp n G C m (lR) with derivatives given by (3.23) and for any 
k — 1, . . . , m, 

< C (y/E[F*] - 3< + \a n - <r|) , 

where the constant C depends only on q, m, 0, M, er, 5 and K. 
Proof. Let <f) n (x) be the density of N(0,a 2 ). Then Theorem 4.4 implies that 

< C q>m>f)tM>ir y/E[F*]-3c*. 
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sup 



Fn 



X) — 



sup 



x) 



X] 



.T 



On the other hand, by the mean value theorem we can write 

\<f>W{x) - <j>W{x)\ < \a n - a\ sup \d^\x)\ = \\a n - a\ sup 7 \^ k+2 h 

7£[f,2 CT ] ^ 76[§,2<t] 

where 7 (x) is the density of the law iV(0,7 2 ). Then, using the expression 

^ +2 \x) = E[l N>x H k Ul-\T 2 Z)l 
where Z ~ iV(0,7 2 ) and the explicit form of ^4.3 (A, x), we obtain 

sup i\^ +2 \x)\<C Ka . 

7€[f,2<r] 

Therefore, 

sup|#(x)-<^(x)| <C k , a \a n -a\. 
This completes the proof. ■ 

5 Random vectors in Wiener chaos 
5.1 Main result 

In this section, we study the multidimensional counterpart of Theorem 4.6. We begin with a 
density formula for a smooth random vector. 

A random vector F = (Fi, . . . , F^) in D°° is called nondegenerate if its Malliavin matrix 
'Jf = ({DFi, DFj) ^)i<i j< d is invertible a.s. and (det7i?)~ 1 G n p >iL p (Q). For any multi-index 

f3 = ((3 1 ,f3 2 ,...,(3 k )e{l,2,...,d} h 

of length k > 1, the symbol dp stands for the partial derivative dx ^ dk g Xp ■ For f3 of length 

we make the convention that dpf = f. We denote by iS(R d ) the Schwartz space of rapidly 
decreasing smooth functions, that is, the space of all infinitely differentiable functions / : 
M. d — > R such that sup^g^ \x\ m \dpf(x)\ < 00 for any nonnegative integer m and for all 
multi-index (3. The following lemma (see Nualart [15, Proposition 2.1.5]) gives an explicit 
formula for the density of F. 

Lemma 5.1 Let F = (Fx, . . . , Fd) be a nondegenerate random vector. Then, F has a density 
f F G 5(R d ), and fp and its partial derivative dpf F , for any multi-index (3 = (/3i,/?2, • • • , Pk) 
of length k > 0, are given by 

f F (x) = E[l {F>x} H (1 , 2 _ d) (F)}, (5.1) 

dpf F (x) = (-l) fc S[l {Ji >.}fr (1A „.^ JlAr .. A) (F)] I (5.2) 
where 1{f>x} = Yl%=i M F i> x i} an ^ ^ e e ^ emen t s Hp(F) are recursively defined by 
H P {F) = 1, *fk = 0; 



H { ^... M {F) = S { H ^Mu-,){F) [If 1 ]" 13 DF^) , if k > 1 . 



(5.3) 
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Fix d natural numbers 1 < q\ < ■ ■ • < q d . We will consider a random vector of multiple 
stochastic integrals: F = (F u . . . , F d ) = (I gi (fi), . . . , I qd (fd)), where /, G S) Qq \ Denote 

V = (ElFiFj])^. .< d , Q = diag(gi, ...,q d ) (diagonal matrix of elements q 1 ,...,q d ). 

(5.4) 

Along this section, we denote by N = (Ni, . . . , N d ) a standard normal vector given by 
Ni = Ii(hi), where hi G are orthonormal. We denote by / the d- dimensional identity 
matrix, and by | • | the Hilbert-Schmidt norm of a matrix. The following is the main theorem 
of this section. 

Theorem 5.2 Let F = (Fi, . . . , F d ) = (I qi (fi), ■ ■ ■ , Iq d (fd)) be nondegenerate and let (f> be 
the density of N. Then for any multi-index (3 of length k > 0, the density fp of F satisfies 



sup \df,Mx) - d^(x)\ <C[\V-I\+ \/ E l F "} ' 3(^[^ 2 ]) 2 ) 
■^ Rd \ i<j<d v / 

where the constant C depends on d,V,Q,k and I|(det7i?) _1 | 



(5.5) 



l(fc+4)2 fe + 3 ' 



Proof. Note that dp<p{x) = (— l) fc -E[l{7v> a: }-^"(i,2,...,(i,/3i,^2,.--,&)(^ r )]- Then, in order to estimate 
the difference between dpfF n and dpcfi, it suffices to estimate 

E[l {F>x} Hp(F)} - E[l {N>x} Hp(N)} 

for all multi-index f3 of length k for all k > d. 

Fix a multi-index /3 of length k for some k > d. For the above standard normal random 
vector N, we have 7jv = I and 5(DNi) = Ni. We can deduce from the expression (5.3) that 
Hp(N) = gp(N), where gp(x) is a polynomial on M. d (see Remark 5.4). Then, 

\E[l {F>x} Hp(F)]-E[l {N>x} Hp(N)}\ 
< \E[l {F>x} gp(F)} - E[l {N>x} gp(N)]\ + E [\Hp(F) - gp(F)\] 
= A x + A 2 . (5.6) 

The term Ai = \E[l^ F>x ^gp{F) — l{ N>x ygp(N)} | will be studied in Subsection 5.3 by using 
the multivariate Stein's method. Proposition 5.10 will imply that A\ is bounded by the 
right-hand side of (5.5). 

Consider the term A 2 = E[\Hp(F) — gp(F)\]. We introduce an auxiliary term Kp(F), 
which is defined similar to Hp(F) with jp 1 replaced by (VQ)~ . That is, for any multi-index 
(3 = (/3i, /? 2 , • • • , (3k) of length k > 0, we define 



Kp{F) = 1 if A: = 0; 

Kp(F) = 5 (K^p^p^F) {{VQY 1 DF)^ if * > 1. 



(5.7) 



We have 



A 2 < E [\Hp(F) - Kp(F)\] + E[\Kp(F) - g p (F)\] =: A 3 + A 4 . (5.8) 

Lemma 5.11 below shows that the term A3 = E [\Hp(F) — Kp(F)\] is bounded by the right- 
hand of (5.5). 
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It remains to estimate A4. For this we need the following lemma which provides an 
explicit expression for the term Kp(F). Before stating this lemma we need to introduce 
some notation. For any multi-index = (A; 02, ■ ■ ■ , AO, k > 1, denote by Ai...i m the 
multi-index obtained from after taking away the elements Ad A2; • • • , A m - For exam- 
ple, A.4 = (02, 03 , 05 , ■ ■ ■ , 0k)- For any d- dimensional vector G we denote by Gp the product 
G Pl Gp 2 ■■■G Pk and set Gp = 1 if the length of /3 is 0. Denote by (S£»; < m < L|J) the 
following sets 



St 1 = S° k = 

{(z'i, i 2 ), . . . , («2m.-i, «2m)} G {1,2,..., /c} 2m : \ (5.9) 
hl-i < ^21 for 1 < / < m and i\ 7^ if I ^ j 



For each element {(21,22), • • • , (^2m-i,*2m)} £ S^ 1 , we emphasize that the m pairs of indices 
are unordered. In other words, for m > 1, the set can be viewed as the set of all partitions 
of {1,2,..., k} into m pairs and k — 2m singletons. 

Denote M = V~ lr jpV~ l Q~ l for V and Q given in (5.4) and denote Mjj the (i,j)-th 
entry of M. Denote by Dp. the Malliavin derivative in the direction of (V~ 1 Q~ 1 DF) B , = 
V- l Q- l DF Pi , that is, 

Dp i G=(DG,(V~ 1 Q~ 1 DF)\ (5.10) 



for any random variable G G ID 1 ' 2 . 

Lemma 5.3 Let F be a nondegenerate random vector. For a multi-index = (At, • • • , AO 
of length k > 0, Kp(F) defined by (5.7) can be computed as follows: 

Kp(F) = Gp(F) + Tp(F), (5.11) 

where 

Lfc/2j 

G P (F) = ^ (-l) n ( V ~ lF )p- ■ ■■■M, i2m _^ m , (5.12) 

* "' l 2m 
"1=0 {(n,j 2 ),---,(i2m-l,«2m)}65™ 

and Tp(F) are defined recursively by 

Tp{F) = (V~ 1 F) h T A (F)-Dp k T h (F) (5.13) 

{(11,12),... ,(i2m-l,i2m)}e5^_ 1 

fork>2 and = T 2 (F) = 0. 

Proof. For simplicity, we write if/3, Gg and T/3 for Kp(F), Gp(F) and Tp(F), respectively. 
By using the fact that 5 (((VQ)" 1 DF) g ^j = (V~ l F) p . we obtain from (5.7) that 

K f>=(y- lF )f, h K ?>- D fh. K ?> ( 5 - 14 ) 

If if A; = 1, namely, = (A), then 

Kb = (V-'F)^ = Gp. 
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If k = 2, namely, j3 — (j3i, (3 2 ), then 

K p =(V- l F) p -M^ 2 =Gp. 

Hence, the identity (5.11) is true for k = 1,2. Assume now (5.11) is true for all multi-index 
of length less than or equal to k. Let (3 = (j3i, . . . , Pk+i)- Then, (5.14) implies 

Noticing that 

ie{l,...,fe}\{il,...,l2m} 

we have 

JW 3 ^ = ^ (5 - 16) 

Lfe/2j 

+ E E (^w^ ^ K ft * ■ • • M **-*») > 

where we let 

Lfc/2j 

^ = E E ^^W^..,^ M ^ M ^- ■ • • M ^-^ m ■ 

m =0 {(U,«2),---,(i2m-l,i2m)}6S'™, 

ie{i,...,fc}\{«i,....i 2m } 

Substituting the expression (5.16) for Dp k+1 Gp k+i into (5.15) and using (5.13) we obtain 

To arrive at (5.11) it remains to verify 

^=(^) A+1 % +1 -^- ( 5 - 17 ) 
Introduce the following notation 

Ck+\ = {{(«l ) *2),---,(«2m-3,«2m-2),(j,^+ 1)} : {(11,12),.. .,(l2m-3,«2m-2)} G ST" 1 } 

(5.18) 

for 1 < m < L|J • Then, Sj^ can be decomposed as follows 

Sr +1 = S™UC™ +1 . (5.19) 

We consider first the case when k is even. In this case, noticing that for any element in 

{(«i, i 2 ), • • • , («2m-i, «2m)} £ S k 2 ,{l,...,k}\ {h, i 2m } = 0- For any collection of indices 
h, ■ ■ ■ , hm C {1, 2, . . . , k}, we set 



*il...*2m = (y 1 ^)^ , M ftlft2 ...M ft2m _ lft: 
^'1 ' ' ' t 2m 
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Then, we have 

Lii-i 

~ B P = E E $j(k+l)h...i 2m 

m =0 {(H,j2)v,(«2m-l,«2m)}6S™, 

j£{l,...,k}\{i lt ...,i 2m } 

= E(-!) n E %(^Dh...w 2 (5-20) 

™=i {(n,i2),... i fe m -3,i 2m -2)}£5™- 1 , 

j'e{l,...,fc}\{ii,...,i2 ?l -2} 
= E ("I")"" E ^j(fc+l)u...i2 m -2 > 

m=1 {(ii,i2),-»(»2 ).Cj.*+i)} 

where in the last equality we used (5.18) and the fact that |_§J = L^"J si nce k is even. Taking 
into account that (V^F), (V^F)?, = (V^F)* , we obtain from (5.12) that 

Lfc/2j 

O^W^ = E (-!) m E (^ li? )ft r ., 2m ^n^---^ 2m _ lft2ro . 

m=0 {(il,ia),.")(»2m-l,i2m)}eSj^ 

(5.21) 

Now combining (5.20) and (5.21) with (5.19) and using again |_f J = L^"J we obtain 

L(*+1)/2J 

(y- lF )»« 1 G %»- B t> = E (-!) m E 

"1=0 {(il,i2),.»>(i2m-l,i2m)}eS0» 
L(fc+1)/2J 

+ E E 

m=1 {(»l,j2),-,(i2m-3,i2m-2),0',fe+l)}6C'™_ 1 
L(*+1)/2J 

= E (- 1 ) m E 

m =0 {(il,i2),-,(i2m-l,i2m.)}eSfe+ 1 
= Gg 

as desired. This verifies (5.17) for the case k is even. The case when k is odd can be verified 
similarly. Thus, we have proved (5.11) by induction. ■ 

Remark 5.4 For the random vector N ~ N(0,I), we have 7^ = VQ = I, so Hp(N) = 
Kp(N). Then, it follows from Lemma 5.3 that Hp(N) = Kp(N) = gp(N) with the function 
gp(x) :M d -)-M given by 

[k/2] 

= E ( _1 ) m E x p iv .^ m s "h"*2--- s "h m -i^^ ( 5 - 22 ) 

where we used 5ij to denote the Kronecker symbol (without confusion with the divergence 
operator). Notice that 



i=i 
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where H^. is the kith Hermite polynomial and for each i = l,...,d, fc, is the number of 
components of f3 equal to i. 

Let us return to the proof of Theorem 5.2 of estimating the term A4. From (5.11) we can 
write 

A 4 = E [\Kp(F) - gp{F)\\ < E [\Gp{F) - g p {F)\\ + E [|7>(F)|] ■ (5.23) 
Observe from the expression (5.13) that Tp{F) is the sum of terms of the following form 

r 

(^ ii7i ) ftlft ,.. fts ^^---^(n M ^^) ( 5 - 24 ) 

i 

for some {ii, . . . , i s , k\, . . . , k t ,ji, h, . . .j r , h-} C {1,2, ... ,k} and t > 1. Applying Lemma 5.5 
with (2.11) and (2.12) we obtain 

E[\Tp(F)\)<Cj2 ||||^|l|-^ 2 ]||!- (5-25) 

l<l<d 

In order to compare gp(F) with Gp(F), from (5.22) we can write gp(F) as 

\k/2\ 

m=0 {(11,12), -,(i2m-l,i2m)}65^ 

Then, it follows from hypercontractivity property (2.11) that 

E [\G P {F) - gp (F)\] < C {\V~ l - I\ + \\M - J|| 2 ) , 

where the constant C depends on k, V and Q. From V" 1 — I = V^ 1 (I — V) we have 
\V~ X - I\ < C\V - I\, where C depends on V. We also have M-I = V" 1 (j F - VQ) V^Q'U 
V^ 1 — I. Then, Lemma 5.5 implies that 

||M-/|| 2 < C (W^-VQh + lV- 1 - I\) 

< c[Yl \\\\ D n\\l-*EFf\\ 2 +\v-i\\, 
\i</<d / 

where the constant C depends on k, V and Q. Therefore 



E[\Gp(F)-ge(F)\]<c(\V-I\+ £ llll^lfi-ft^ll!) 

\ l<Z<d / 



(5.26) 



Combining it with (5.25) we obtain from (5.23) that 



a 4 <c(\v-i\+ \\\\ DF i\\l-^ EF ^\\l) , 

V i<i<d ) 

where the constant C depends on d, V, Q. This completes the estimation of the term Aj. 
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5.2 Sobolev norms of 7^ 

In this subsection we estimate the Sobolev norms of jp 1 , the inverse of the Malliavin matrix 
7i? for a random variable F of multiple stochastic integrals. We begin with the following 
estimate on the variance and Sobolev norms of (tf)^- = (DFi, DFj)^, 1 < i,j < d, following 
the approach of [8, 11, 13]. 

Lemma 5.5 Let F = I p (f) and G = I q (g) with f G 9} &p and g G Sj Qq for p,q > 1. Then 
for all k > there exists a constant C VA ^ such that 

\\D k {(DF,DG)^ - y/pqE[FG\)\\ 3 (5.27) 
< C m , k (\\F\\l + ||G||;)(||||DF||J -pE [F 2 ] ||| + || \\DG\\l-pE [G 2 ] ||f ). 

Proof. Without lost of generality, we assume p < q. Applying (2.4) with the fact that 
DI p (f) = p/ p _i(/) we have 



(DF, DG) Sl = pq (I p -i(f), I q -\{g))^ (5.28) 

p— 1 



r=0 



= «£(r-l)l(*_|)(*_ |) W* • 

Note that £[FG] = if p < g and E[FG] = (f, g)^ p = f® p g if p = q. Then 

(DF, DG)^ - y/pqE(FG) = pqf^l - 5 qr ) (r - 1)! ^ ~ ^ ^ ~ ^ J p+g _ 2r (/® r <?) , 

where 5 gr is again the Kronecker symbol. It follows that 

E [(DF, DG)^ - VpqE[FGf (5.29) 

= fV E(l " 8 v )(r - 1)! 2 (^ I J) 2 (" I J) 2 (P + ^ " 2^)! ||/^fc (pW) • 
Note that if r < p < g, then (see also [11, (6.2.7)]) 

||/ ( 8r5 , ||^ Kl (p+ < ,-2r) ^ \\f ®r g\\ft®( P +q-2r) = (f ®p-r f i g ®q-r g) 

< \(\\f® P -r filler + \\g® q - r g\\l®2r), (5.30) 

and if r = p < q, 

\\f® P 9\\l®( q -p) < \\f® P 9\\lvh-p) < \\f\\%9p \\g ®g-P 9\\^2 P ■ (5.31) 
From (4.5) and (4.6) it follows that 



|| \\DF\\l - pE [F 2 ] \\l = p 4 ]T> - l)! 2 ( P _ jY (2p - 2r)\ \\f ® r f\\%^- 2r) . (5.32) 

r=l ^ r ' 
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Combining (5.29)-(5.32) we obtain 

E[(DF : DG)^-^pqE[FG]] 2 
< C M (\\ \\DF\\l - pE [F 2 ] \\l+\\F\\l\\ \\DG\\l - pE [G 2 ] || 2 ). 

Then (5.27) with k = follows from \\\\DF\\\-pE [F 2 ]|| 2 < C p \\F\\\, which is implied by 
(2.12). From (5.28) we deduce 

D - (df, Do, = P(^ PA[ "g'" /2, < r - 1)! (; : ;) (* : ;) _z±jl^ w _ 2r {fS - rg] . 



Then it follows from (5.30)-(5.32) that 
E\\D k (DF,DG)^ h 

pA[(p+q-k)/2] , N 2 / 1N 2 / . o M2 

-a- e (r-.)p(;:;) (; = ;) ^t^. ||^i^, 



< 



r=l 

ll^lfi - ^ II, + ll^lla II W DG t ~ P E [ G *] 



\2>' 



This completes the proof. ■ 

The following lemma gives estimates on the Sobolev norms of the entries of jp . 

Lemma 5.6 Let F = (Fi,...,Fd) = (I qi (fx),...,I qd (fd)) be nondegenerate and let jp = 
((DF^DFi)^)^. .^. Set V = [E^]) 

i<ij<d- Then for any real number p > I, 
b?\\ p <C\\{teby F )-\, (5.33) 

where the constant C depends on qi, . . . , qd, d,p and V . Moreover, for any integer k > 1 and 
any real number p > 1 

H\ p < C ||(det 7F )- 1 ||^ + 1 2)2?3 £ || II^HJ - q t E [Ff] || 2 , (5.34) 
where the constant C depends on q±, . . . , qd, d,p, k and V. 

Proof. Let jp be the adjugate matrix of jp. Note that Holder inequality and (2.12) imply 

WiDF^DF^^ < \\DF\\ 2p WDF^ < C v>p 

for all 1 < i, j < d, p > 1. Applying Holder's inequality we obtain that the p norm of 7^ is also 
bounded by a constant. A further application of Holder's inequality to jp 1 = (det 7 ir) _1 7^ 
yields 

hF%< H(det7F)- 1 || 2p || 7>|| 2p <C y , P ||(det7F)" 1 || 2p , (5.35) 
which implies (5.33). 

Since F is nondegenerate, then (see [15, Lemma 2.1.6]) (jp 1 )^ belongs to D°° for all i,j 
and 

d 

D {1f% = - E fe 1 )- D Mmn ■ (5-36) 



m,n=l 



28 



Then, applying Holder's inequality we obtain 

\\ d ^f% < IIt^H^II^IU- 

d 

< C v>p \\(det lF rX p J2 II \\DF t \\l - qi E [Ff] || 2 , 

i=i 

where in the second inequality we used (5.33) and 

d 

\\D lF \\, p < C v , p \\D lF \\ 2 < C V , P Y, - QiE [F*] || 2 

for all p > 1, which follows from (2.12) and (5.27). This implies (5.34) with k — 1. For 
higher order derivatives, (5.34) follows from repeating the use of (5.36), (2.12) and (5.27). ■ 
The following lemma estimates the difference 7^ — V~ 1 Q~ 1 . 

Lemma 5.7 Let F = (F 1; . . . , F^) = (I qi (fi), . . . , I qd {fd)) be a nondegenerate random vector 
with 1 < q% < ■ • • < and fi G $) &qi . Let 7^ be the Malliavin matrix of F. Recall the 
notation of V and Q in (5.4). Then, for every integer k > 1 and any real number p > 1 we 
have 

hF'-y-'Q-X^cUdet^rX^ y: \W\mwi-QiEm\l (5.37) 

l<l<d 

where the constant C depends on d, V, Q,p and k. 

Proof. In view of Lemma 5.6, we only need to consider the case when k = because V and 
Q are deterministic matrices. Note that 

7 -i _ V -iQ-i = 7 -i (vq _ lF )V~ l Q-\ 
Then, applying Holder's inequality we have 

W - V-'Q'X < C V , Q \\ lF % p \\VQ - lF \\i v - 
Note that (2.12) and (5.27) with k = imply 

d 

\\VQ - i F \\ 2p < C VtQtP \\VQ - lF \\ 2 < C VtQ , p \\\\DFi\\l - QiE [Ff] ||J . 

i=i 

Then, applying (5.35) we obtain 

|| 7 -i _ V^Q~\ < Cwa^WWDFiWl - q % E [Ff] \\l (5.38) 

i=i 

as desired. ■ 
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5.3 Technical estimates 

In this subsection, we study the terms A\ = \E[h(F)] — E[h(N)]\ in Equation (5.6) and 
A3 = E [\Hp(F) — Kp(F)\] in (5.8). For A±, we shall use the multivariate Stein's method to 
give an estimate for a large class of non-smooth test functions h. 

Lemma 5.8 Let h : IR d — >• K be an almost everywhere continuous function such that \h(x) \ < 
c (\x\ m + 1) for some m, c > 0. Let F = (Fi, . . . , Fa) be nondegenerate with E[Fj\ = 0, 1 < 
i < d and denote N ~ ^(0, 1). Then there exists a constant C m , c depending on m and c such 
that 

d 

\E[h(F)]-E[h(N)}\<C m ,c(\\F\\2m + 1 ) E IK^WU^OIL' (5 ' 39) 

i,j,k=l 

where 7^ is the inverse of the Malliavin matrix of F and 

Mj = Sij - (DFj, -DL^F^ . (5.40) 

Proof. For e > 0, let 

h e (x) = (l| M< i|/i) * pe(x) = J l lyl< ih(y)p £ (x - y)dy. 

where p £ is the standard molifier. That is, p e (x) = ^p(|), where p(x) = Cl{| a |<i} exp( | 3 .i_ 1 ) 

and the constant C is such that J Rd p{x)dx = 1. Then h e is Lipschitz continuous. Hence, the 
solution f e to the following Stein's equation: 

Af e (x) - (x, V/ 6 (x)) Rd = h e (x) - E[h e (N)} (5.41) 

exists and its derivative has the following expression [11, Page 82] 

.1 1 



dj e (x) = ^- J ^E[h £ (Vix + VT^tN)]dt 

= / E[hJ y rt.T. + y/T=tN)Ni] dt 
Jo 2\/ty\ — t 



(5.42) 



It follows directly from the polynomial growth of h that 

\K{x)\ < d \x\ m + C 2 (5.43) 

for all e < 1, where Ci, C2 > are two constants depending on c and m. Then, from (5.41) 
we can write 

\d i h{x)\<C 1 \x\ mj rC 2 , 
with two possibly different constants Ci, and C 2 - Hence, 

\W e (F)\\2<Oi\\F\\Z + C2. (5.44) 
Meanwhile, note that for 1 < i < d, 

E[FAfe(F)} = E[LL- 1 FAfe(F)]=E[(-DL- 1 F t ,DdJ £ (F))] 
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= E E[(—DL~ l Fi, dijf E (F)DFj)]. 
Then, replacing x by F and taking expectation in Equation (5.41) yields 



\E[h £ (F)] - E[h £ (N)}\ 

Notice that 

(DFi, Ddif e (F)) Si = (DF i ,Y / ^ j fe(F)DF 3 ) = J>J/ £ (F) (DF i ,DF j ) j 



(5.45) 



3=1 



for all 1 < i, k < d, which implies 



i,j=l i,j=l 

d 

= 5> 

*j=i 



fe=l 

and hence 

d d f / d 

AijiY.^^DF^Dd.UF) 

\k=l 

d t fe(F)5 [A^^^m 

V fe=i 

Substituting this expression in (5.45) and using (5.44) we obtain 

d 

\E[h £ {F)] - E[h E {N)]\ = E E [ d *fe(F)5 (A l3 {r F l ) jk DF k ) 

i,j,k=l 
d 

< E ||^/ e (F)|| 2 ||5(^( 7 ^). fcJ DF, 

i,i,fe=l 

< (Ci||F||L + C 2 ) E jsfafe^DF, 



i,j,k=l 



Then, we can conclude the proof by observing that 

\im\E[h £ (F)]-E[h £ (N)] \ = \E[h(F)]-E[h(N)]\ 



£-S>0 



which follows from (5.43) and the fact that h e —> h almost everywhere. 



The next lemma gives an estimate for 
multiple stochastic integrals. 



when F is a vector of 
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Lemma 5.9 Let F = . . . , F d ) = (I qi (fi), . . . , I qd (f d )), where fi G f) % be nondegenerate 
and denote N ~ N(0,I). Recall the notation of V and Q in (5.4) and A^ in (5.40). Then, 
for all 1 < i, j, k < d we have 



-1 1 1 3 
II 12 



5(^( 7F 1 ) jfcJ DF fe )| 2 < C\\(det lF y 

\v-i\+it\\\\ DF *\\i-<i> E [ f ?]\\I 



(5.46) 



i=i 



where the constant C depends on d,V,Q. 

Proof. Applying Meyer's inequality (2.9) we have 



< 



Applying Holder's inequality and (2.12) we have 

\ A H h~F l ) 3k DF k \ 2 < \\A t] \\ 2 || (7^) jfc || 4 \\DF k \\ 4 < C d>v>Q \\A tJ \\ 2 \\(j^) jk 
Similarly, Holder's inequality and (2.12) imply 

+ iia j ii 2 ||^(7f 1 ) j 4 + ii^ii 2 ||(^ 1 U||4 ] - 

Combining the above inequalities we obtain 

6 ( A V fe%^*)|| a < CV,Q ||^|| 1)2 H^ 1 ), 



'jk 



1,4 



Note that 



Aij = 8ij - (DFj, -DL" 1 ^) = S iS - V i3 + V i5 - - (DFj, -DF^ . 
Then, it follows from Lemma 5.5 that 



||Aill 1)2 < C d>VjQ [\V - 1\ + II \\ DF *\\l ~ Qi F [ F f\ 



i=l 



Then, the lemma follows by taking into account of (5.34) with k — 1. ■ 
As a consequence of the above two lemmas, we have the following result. 

Proposition 5.10 Let h : M d — > M. be an almost everywhere continuous function such that 
\h(x)\ < c(\x\ m + 1) for some m,c> 0. Let F = (F 1 , . . . , F d ) = (I qi {fi), . . .,I qa (f d )), where 
fi G $) &qi , be nondegenerate and denote N ~ N(0,I). Recall the notation of V and Q in 
(5.4). Then 



1 1 1 3 
1 1 12 

d 



\E[h{F)\ - E[h{N)}\ < C||(det7 F ) 

IV-Il+^WWDFiWl-qiE [Ff] 
where the constant C depends on d, V, Q, m, c. 



(5.47) 



x 



i 

21 II 2 



12 ' 
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In the following, we estimate the term A 3 = E [\Hp(F) — Kp(F)\] in (5.8), where Hp(F) 
and Kp(F) are defined in (5.3) and (5.7), respectively. 

Lemma 5.11 Let F = (Fi,...,F^) = (I qi (/i ),•••, Iq d (fd)) be nondegenerate. Let (3 = 
(/?!,..., /3k) be a multi-index of length k > 1. Let Hp(F) and Kp(F) be defined by (5.3) 
and (5.7), respectively. Then there exists a constant C depending on d,V,Q,k such that 



E[\Hp(F)-Kp(F)\] < C||(det 7 F) 



ll(fc+4)2 fe +3 



(5.48) 



x 



2 

2 ' 



i=l 



Proof. To simplify notation, we write Hp and Kp for Hp(F) and Kp(F), respectively. From 
(5.3) and (5.7) we see that 



Hp-K p = S (H h [T F X DF) Pk - K h {{VQY 1 DF\ 



where /3k = {/3 



i- 



,/Sjb-i). For any s > 0,p > 1, using Meyer's inequality (2.9) we obtain 
WHh-K* 



< C 



s.p 



< c 



s,p 



Then, Holder's inequality yields 

\\Hp-Kp\ 



H Ab' F l DF) h -K^{{yQY l DF) h 
HpMl^-iYQr 1 ) DF) 



s+l,p 



s+l,p 
s+l,p 



< 



s+l,2p 



{(VQy'DF) 



0k 



+ 



H 



s+l,2p 



s+l,2p 

s+l,2p 



Note that (2.12) implies ((VQ)^ 1 ^i 71 )^ 
inequality and (5.37) indicate 



< Cdy,Q, s ,p- Also note that (2.12), Holder's 



s+l,2p 



where we denote 



s+l,2p 



< C di y,Q, SiP A ||(det7 F ) 



-l|is+2 
ll(s+3)8p 



l<Z<d 

to simplify notation. Thus we obtain 



l#/8--K>l 



< a 



d,V,Q,s,p 



s+l,2p 



(5.49) 
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+a 



d,V,Q,s,p*- 



I (det 7f) 



-l\\s+2 



s+l,2p" ' ' 'U«+3)8p - 

Similarly, from Meyer's inequality (2.9), Holder's inequality and (2.12) we obtain by iteration 



\s,p — Cs,p 



s+l,p 



< c d . 



V,Q,s,p 



H 



s+l,2p 



I (det 7 F ) 



-II 1 8+2 



I (s+3)8p 



< C d , 



I (det 7j?) 



_l||fc(s+fc) 



,V,Q,s,p,k \\V±^ f-fV ll( s +fe+l)2 fe + 2 p ' 

Applying (5.50) into (5.49) and by iteration we can obtain 

\\ H P - K p\\s, p < C d,V,Q,s,p,k ||( det 7f) _1 ||p s 2 +t+t) 2 2^ P A " 

Now (5.48) follows by taking s = 0, p = 2 in the above inequality. ■ 



(5.50) 



6 Uniform estimates for densities of general random 
variables 

In this section, we study the uniform convergence of densities for general random variables. 
We first characterize the convergence of densities with quantitative bounds for a sequence 
of centered random variables, using the density formula (3.10). In the second part of this 
section, a short proof of the uniform convergence of densities (without quantitative bounds) 
is given, using a compactness argument based on the assumption that the sequence converges 
in law. 

6.1 Convergence of densities with quantitative bounds 

In this subsection, we estimate the rate of uniform convergence for densities of general random 
variables. The idea is to use the density formula (3.10). 
We use the following notations throughout this section. 



w 



[DF, -DL-'F)^ 
The following technical lemma is useful. 



u 



-w- x DL~ x F. 



Lemma 6.1 Let F G © 2>s with s > 4 such that E [F] = and E[F 2 ] = a 2 . Let m be the 
largest even integer less than or equal to | . Then there is a positive constant C m such that 
for any t <m, 



\w — <7 2 || t < || W — (J 2 | 



< C m \\Dw\\ < C m \\Dw\ 



(6.1) 



Proof. It suffices to show the above second inequality. From the integration by parts formula 
in Malliavin calculus it follows 



a' 



E[F 2 



E 



[DF ~DL- 1 F) i 



E\w] 
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Note that from (3.9) and (3.13) we have w G 3 1 '2. Then the lemma follows from the following 
infinite-dimensional Poincare inequality [11, Lemma 5.3.8]: 

E[(G - E [G]) m } <{m- l) m/2 E \\\DG\\™] , 

for any even integer m and G G 3 1,m . ■ 

The next theorem gives a bound for the uniform distance between the density of a random 
variable F and the normal density. 



Theorem 6.2 Let F G D 2 ' s with s > 8 such that E [F] = 0, E[F 2 } = a 2 . Suppose M r : = 
E [|w|~ r ] < oo, where w = (DF, —DL~ l F) Sl and r > 2. Assume 2 + | = 1. T/ien F admits 
a density /f(x) and there is a constant C r)Sjaj M depending on r,s,a and M such that 



sup \f F {x) 



(x) I < C r s a- 



id 



\D F\ 



op 



0,s 



(6.2) 



where <f)(x) is the density of N ~ N(0, a 2 ) and \\D 2 F\\ op indicates the operator norm of D 2 F 
introduced in (3.9). 

Proof. It follows from Proposition 3.3 that F admits a density given by }f{x) = E [l{p>x}0~ (w)] 
Then 

SUp - <j>(x)\ = SUp |E [1{F>x-}<$ («)] - cr~ 2 -E[l{7V>x}iV]| • 



Note that, from (2.7) 

5(u) = 5(—DL~ 1 Fw~ 1 ) = Fw- 1 + {Dw-\DL~ l F)^ 

Then 



(6.3) 



\E[a 2 l {F>x} 5(u)} -E[1 {N>X} N}\ 
< E [\Fw~\a 2 -w)\] +a 2 E \ (Dw^\DL~ 1 F) s 

+ \ E [F1{ F>X } — A r l( A r >x }] | . 



(6.4) 



Note that for + , we have | — t > 2, so there exists an even integer m G [t, |]. 

1. Then, we can apply Holder's inequality and (6.1) to obtain 



Also, we have r + - + 7 



r s t 

E ^Fur 1 ^ — a 2 )\] < \\F 

< Cr.s \\F 



Iw- 1 



w — 0" 
Dw 



s/2 ■ 



Meanwhile, applying Holder's inequality and (3.7) we have 



(6.5) 



E 



w- 2 



Dw,-DL~ 1 F) S 



\Dw\\s Wdl^fI 



\Dw\\. \\DF\ 



(6.6) 



Also, applying Lemma 2.2 for h(y) = yl{ y>x y and (6.1) we have 

\E [F1 F>X - N1 N>X ]\ < C a \\a 2 - w\\ < C a \\Dw\ 



s/2 



(6.7) 
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Applying the estimates (6.5)-(6.7) to (6.4) we have 

\E [a 2 l F>x 5 (u)] -E[1 N>X N} \ < C r ^ M \\F\\ hs \\Dw\\ s/2 
Combining (6.3), (6.8) and (3.13) one gets 



(6.8) 



SUp \Jf(x) ~ <P{x)\ < <7 r ,s,<7,Af \\F\ 



1,8 



\D F\ 



op 



This completes the proof. ■ 

Corollary 6.3 Let {F n } nm C D 2,s with s>8 such that E [F n ] = and lim^oc E[F 2 ) = a* 
Assume E[F 2 ] > 5 > for all n. For r > 2 such that - + - = 1, assume 

(%) Mi = sup n ||-F„|| liS < oo. 
(it) M 2 = swp n E\(DF n , -DL- l F n )^\~ r < oo. 
(Hi) E ||_D 2 F n ||^ as n -> oo. 

Then each F n admits a density fp n (x) and , 



(x)\<C 



\D F r , 



op 



+ \E[F 2 ] - a 2 \) 



(6.9) 



where the constant C depends on o~,Mi,M 2 and 5. Moreover, if M 3 = sup n Hi 7 ^ || 2s < oo ; 
then for any k > 1 and a G {\,k), 



\L k ( 



< c 



\D F n 



I op 



where the constant C depends on a, Mi, M 2 , M 3 , a and S. 

Remark 6.4 By the "random contraction inequality" (3.9), a sufficient condition for (hi) is 
E \\D 2 F n (g)! D 2 F n \\$ 3 -»• or E \\D 2 F n \\% m -> 0. 

Proof of Corollary 6.3. It follows from Theorem 6.2 and Proposition 3.3 with an argument 
similar to Corollary 4.3. ■ 



6.2 Compactness argument 

In general, convergence in law does not imply convergence of the corresponding densities 
even if they exist. The following theorem specifies some additional conditions which ensure 
that convergence in law will imply convergence of densities. 

Theorem 6.5 Let {-F n } ngN be a sequence of random variables in D 2,s satisfying any one of 
the following two conditions: 

sup ||F n || 2)S + sup ||F n || 2p + sup ||||DF n ||~ 2 || r < oo (6.10) 

n n n 
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for some p, r, s > 1 satisfying i + £ + i = 1, or 

< oo (6.11) 

for some r, s > 1 satisfying - + - = 1 . 

Suppose in addition that F n — >■ AT ~ AT(0, cr 2 ) m /aw. T/ien eac/i F n admits a density 
f Fn G C(R) groen fry either (3.1) or (3.10), and 

sup |/j?„(x) - 0(x)| -> 
as n ^ oo, where <fi is the density of N. 

Proof. We assume (6.10). The other condition can be treated identically. From Theorem 3.1 
it follows that the density formula (3.1) holds for each n and for all i,i/6l 

|/f„(x)|<C(1Ax- 2 ), 

\f Fn (x)-f Fri (y)\<C\x-y\t. 

Hence the sequence {/fw} C C(R) is uniformly bounded and equicontinuous. Then apply- 
ing Azela-Ascoli theorem, we obtain a subsequence {./>„} which converges uniformly to a 
continuous function / on R such that < f(x) < C(l A x~ 2 ). Then /p n — > / in L X (M) as 
k — > oo with ||/|| L i( R ) = lim fc ||/p njk = 1- This implies that / is a density function. Then 

/ must be because F n converges to A" in law. Since the limit is unique for any subsequence, 
we get the uniform convergence of fF n to <fi. ■ 

Corollary 6.6 Let {.F n } neN be a sequence of centered random variables in D 2 ' 4 with the 
following Wiener chaos expansions: F n = Ylq*Li JqFn- Suppose that 

(i) liniQ^oolimsup^^E^Q+i^tl^nl 2 ] = 0. 
(%%) for every q>l, Hindoo E[( J q F n ) 2 } = cr 2 . 

(iv) for all q > I, (D (J q F n ) , D(J q F n ))^ — > qa 2 q , in L 2 (f2) as n — >■ oo. 
(v) supJ|Fj 2)4 + sup n S[||DF n ||~ 8 ] < oo. 
Then each F n admits a density fp n (x) and 

sup|/f„(x) -0(z)| -> 

as n — > oo, where <fi is the density of N(0,a 2 ). 

Proof. It has been proved by Nualart and Ortiz-Latorre in [16, Theorem 8] that under 
conditions (i)-(iv), F n converges to AT ~ N(0,a 2 ) in law. The condition (v) implies (6.10) 
with s = 4,p = 2, r = 4. Then we can conclude from Theorem 6.5. ■ 



SUp H-FnLs + SU P 



[DF n ,-DL- 1 F n ) s 
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7 Applications 



The main difficulty in applying Theorem 4.1 or Theorem 5.2 is the verification of the non- 
degeneracy condition of the Malliavin matrix: sup n -E[||-DF n ||^ p ] < oo or sup n -E[|det 7i? n p p ] < 
oo, respectively. In this section we consider the particular case of random variables in the 
second Wiener chaos and we find sufficient conditions for sup n -EfH-Di^H^] < oo. As an ap- 
plication we consider the problem of estimating the drift parameter in an Ornstein-Uhlenbeck 
process. 

A general approach to verify E [G~ p ] < oo for some positive random variable and for some 
p > 1 is to obtain a small ball probability estimate of the form 

P{G < s) < Ce a for some a > p and for all e G (0, e ), (7.1) 

where Sq > and C > is a constant that may depend on e and a. We refer to the paper 
by Li and Shao [6] for a survey on this topic. However, finding upper bounds of this type 
is a challenging topic, and the application of small ball probabilities to Malliavin calculus is 
still an unexplored domain. 

7.1 Random variables in the second Wiener chaos 

A random variable F in the second Wiener chaos can always be written as F = I%{f) where 
/ G f) 02 . Without loss of generality we can assume that 

oo 

f = ^ j \ l e i ^e i , (7.2) 
i=i 

where > 1} verifying |Ai| > | A2 1 > ■ ■ ■ > |A n | > . . . are the eigenvalues of the Hilbert- 
Schmidt operator corresponding to / and {e^, i > 1} are the corresponding eigenvectors form- 
ing an orthonormal basis of Then, we have F = 12(f) = ^i(-^i( e «) 2 — 1); 

00 

J DF = 2^A l / 1 (e i )e, (7.3) 

and 

00 

i=l 

The following lemma provides necessary and sufficient conditions for a random variable of 
the form (7.4) to have negative moments. 

Lemma 7.1 Let G = (X^i^i^?)^? where {Xi} i>t satisfies |Aj| > |Aj+i| for all % > 1 and 
{Xi} i:>1 are i.i.d standard normal. Fix an a > 1. Then, E[G~ 2a ] < 00 if and only if there 
exists an integer N > 2a such that |Ajv| > and in this case there exists a constant C a 
depending only on a such that 

E[G~ 2a ) < C a N- a \X N \- 2a . (7.5) 
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Proof. Notice X~ a = ^ J °° e'^y^dy and E[e 
N > 2a such that |Av| > 0, then 



~ tx i] = -j= t for all t > 0. If there exists 



E[G~ 



-2ai 



< E 



N 



,i=i 



r a) 



-E 



e-y&^ x ?y^dy 



Uo 



—J y a - 1 H(l + 2\*y)- l >dy. 



(7.6) 



Since A 2 is non increasing in i and N > 2a, using the change of variables 1 + 2\ 2 N y = z we 
have 



poo N „ c 

/ y a - l H(l + 2\2y)-3dy< 
Jo i=1 Jo 



y a ~ 1 (l + 2X 2 N y)"dy 



(2X 2 N y a I (z-l) a - 1 z-^dz={2\%) 



z - 1 



Q-l 



z a ~ l ~^dz 



(2\ 2 N y a i (i - xr-'x^-'dx = (2\ 2 N y a r(a)r( * a) 



V{N/2) 
which implies (7.5). 

On the other hand, if |Aj| = for all i > 2a, let N < 2a be the largest nonnegative 
integer such that |Ajv| > 0. Then, the inequality in (7.6) becomes an equality. Using again 
that {Af} i>1 is a decreasing sequence we have 

l>00 N „X nQQ 

/ y a - 1 T\(l + 2X 2 y)-hy>(l + 2X 2 1 )-^( y a - 1 dy+ y a - l ^dy) = oo, 
Jo i=1 Jo Jl 

and we conclude that E[G~ 2a ] = oo. This completes the proof. ■ 

The following theorem describes the distance between the densities of F — 12(f) and 
N(0,E[F 2 }). 

Theorem 7.2 Let F = 12(f) with f e i} 02 given in (7.2). Assume that there exists N > 
6m + 6 (Lf J V 1), for some integer m > 0, such that Xn 7^ 0. Then F admits an m 
times continuously differentiable density fp. Furthermore, if 4>(x) denotes the density of 
N(0,E[F 2 ]), then fork = 0,1, 



sup 



fj>\x) - <P^(x) < C 5>M < C (E{F*] - 3 (E[F 2 ]) 



-,2n\2\ 2 



.1=1 



where the constant C depends on N and X^. 
Proof. Taking into account of (7.4), we have 



Var(||DF|| 2 ) =E 



4^A l 2 (/i(e,) 2 -l) 



i=i 



i=l 



(7.7) 
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From (7.4) and Lemma 7.1 it follows that 



E[\\DF\\-P] < C 0/2 N-e/ 2 \\ N \-e, 



(7.1 



for all (3 < N . Then, the theorem follows from Theorem 4.4, taking into account (7.7). ■ 

Now we are ready to prove convergence of densities of random variables in the second 
Wiener chaos. Consider a sequence F n = hifn) with /„ e -f} 02 , which can be written as 



(7.9) 



i=l 



where {X n ,i, i > 1} verifies |A n> i| > |A n) i+i| for alH > 1 and {e ni j, i > 1} are the corresponding 
eigenvectors. 

Theorem 7.3 Let F n = ^(/n) with f n G S) &2 given by (7.9). Assume that {A n) j} nigN sat- 
isfies 

(i) a 2 :=2\im n ^ 00 YZA>^ 
(ii) ^im n ^ooJ2ZiKi = °> 

(Hi) inf„ rsup i>6m+6 /^j vl \ \\ n ,i\Vi) > f or some integer m > 0. 

Then, each F n admits a density function fp n 6 C m (M). Furthermore, for k = 0, 1, . . . , m 
and if 4> denotes the density of the law N(0,a 2 ), the derivatives of f^ converge uniformly to 
the the derivatives of with a rate given by 



sup 



(*)/ 



< C 



8=1 



2 £ A n,i " ^ 



i=l 



where C is a constant depending only on m and the infimum appearing in condition (Hi). 
Proof of Theorem 7.3. Note that E[(h(e n ^ 2 - l)(/i(e nj ) 2 - 1)] = 2%. Thus, 



£^n,i - ll/n||^©2 - -E[Fl\. 



i=l 



Then, the result follows from (7.7), (7.8) and Corollary 4.6. ■ 

Condition (hi) in Theorem 7.3 means that there exist a positive constant 5 > such that 
for each n we can find an index i(n) > 6m + 6 V l) with \\ n ,i(n)\\/i( n ) > S. 

7.2 Parameter estimation in Ornstein-Uhlenbeck processes 

Consider the following Ornstein-Uhlenbeck process 



x t = -e x s ds + 1 B t , 

Jo 
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where 9 > is an unknown parameter, 7 > is known and B = {B t , < t < 00} is a 
standard Brownian motion. Assume that the process X = {X t , < t < T} can be observed 
continuously in the time interval [0, T]. Then the least squares estimator (or the maximum 

- J T X t dX t 

likelihood estimator) of 9 is given by 9t = -^-f • It is known (see for example, [4], [5]) 



r-T 

i_ 

-T 



that, as T tends to infinity, 9t converges to 9 almost surely and 



Jo X?dt 



y/f(9 T _ 0) = - - T -±— 4 N{0, 29), (7.10) 

where 



Jo X?dt 

F t = Wt)= [ [ f T (t,s)dB t dB s , (7.1i; 
Jo Jo 



with 



, 2 



/ T ( fja ) = -^_ e -«l*--l. (7.12) 



motion with Hurst parameter He which includes the standard Brownian motion case 



r 

2VT" 

Recently, Hu and Nualart [3] extended this result to the case where B is a fractional Brownian 

I 3X 
2' l>i 

Since ^ J Q Xfdt — > \ r ) 2 9~ 1 almost surely as T tends to infinity, the main effort in proving 

4 

(7.10) is to show the convergence in law of Ft to the normal law N(0, 7^). We shall prove that 
the density of Ft converges as T tends to infinity to the density of the normal distribution 

Theorem 7.4 Let Ft be given by (7.12) and let 4> be the density of the law N(0,a 2 ), where 
a 2 = 31. Then for each T > 0, Ft has a smooth probability density fp T and for any k > 0, 



sup 



1 F T 

where the constant C depends on k, 7 and 9. 



< CT~i. 



Before proving the theorem, let us first analyze the asypmototic behavior of the eigen- 
values of Jt- The Hilbert space corresponding to Brownian motion B is S) = L 2 ([0,T}). Let 
Qt '■ L 2 ([0,T]) — > L 2 ([0,T]) be the Hilbert-Schmidt operator associated to fx, that is, 

(Q T <p)(t)= [ f T (t,s)tp( S )ds (7.13) 



for tp E L 2 [0, T]. The operator Q T has eigenvalues A r i > \ T) 2 > • ■ • > and ^Ti < 00 • 
The following lemma provides upper and lower bounds for these eigenvalues. 

Lemma 7.5 FixT > 0. Let fa be given by (7.12) andQT be given by (7.13). The eigenvalues 
^T,i of Qt ( except maybe one ) satisfy the following estimates 

-i 2 9 -i 2 9 

< A T , < 7-^- 5s-. (7.14) 
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Proof. Consider the eigenvalue problem Qt^P = Ay?, that is, 
t 7 2 / r t rT 



f T (t, sMs)ds = (jf e- e ^ V {s)ds + I e- e ^ V (s)ds ) = \<p(t). (7.15) 



Then, is differentiable and 

,2/3 / r t 



^9 

Differentiating again we have 
7 2 # 



e 



e ^~ s ^(s)ds+ e- e ^(p(s)ds)=X<f/(t). (7.16) 



2a / rt pT 

-2(p(t) + 9 / e- eit - s) ^{s)ds + 9 / e- 9(s - i V(s)rfs ) = \<p"(t). 



1-s/T 

Comparing this expression with (7.15), we obtain 

(0 2 -^Mt)=^"(t). (7.17) 
Also, from (7.15) and (7.16) it follows that 

<p(p) = e<t/(p), <p(T) = -etf/(T). (7.i8) 

Equations (7.17) and (7.18) form a Sturm-Liouville system. Its general solution is of the 
form 

<p(t) = C\ sin /it + C*2 cos fit, 

where C\ and Ci are constants, and \i > is an eigenvalue of the Sturm-Liouville system. 
By eliminating the constants C\ and C2 from (7.17) and (7.18) we obtain 

= (7.19) 

Then, the desired estimates on the eigenvalues of Qt<£ = Ay?will follow form estimates on \i. 
Note that the Neumann condition (7.18) yields 

(fj 2 9 2 — 1) sin \iT = 2fi9 cos jiT. 

If we write x = fi9 > (since /i, 9 > 0), the above equation becomes 

(x 2 — 1) sin ^-T = 2x cos ^T. 

9 9 

The solution x — 1 corresponds to the eigenvalue \i = |. If x 7^ 1, then cos |T 7^ and 

2x 

tan-T = ^— . 7.20 
t/ or — 1 

For any i G Z + , there is exactly one solution X{ to (7.20) such that yT e (i7r — |,Z7T + |). 
Corresponding to each Xj is an eigenvalue /ij = y of the Sturm-Liouville system, satisfying 

Z7T — ? Z7T + j 

— < ^ < — j' ' ^ e corres P on ding eigenvalue Aj of Qt obtained from Equation 
(7.19) satisfies the estimate (7.14). ■ 
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Proof of Theorem 7.4. For each T, let us compute the second moment of Ft- 

fr{t, s) 2 dsdt 



„4 rT ft 



i2 

If)® 2 



JO 



= 2!_X:fl-e- 20T ). 



1_ 

AT 



./0 



2# 89T 



Also, noticing that F T = hifr) = <^ 2 (/r) and 

D s D t F^, = 3F*f T (t, s) + QFrhifi-, t)) <g> I^-, s)), 
and using the duality between 5 and .D, we can write 



3E [F% (f T , fr)^] 
+6E [F T (f T (t, s), h(f T (; t)) ® I^/tO, s)))^] 
3(E [F 2 ]) 2 + 6A 



where 



A = J E[F r (/ r (t, S ),/ 1 (/ T (-,t))®/ 1 (/ r (-, S )))^ 2 ] 
= (/t(u,«), (fAt,s)J T (u,t) ® /r(v, s))^ ^ 



16T 2 j j j j 
Because the integrand is symmetric, we have 



.4 



7 C 



16T 2 



A\ du dv ds dt e - 2e{u - t} < CT 



'0 </o 

Then, in order to complete the proof by applying Corollary 4.6, we only need to verify 
that condition (iii) of Theorem 7.3 holds for any integer m > 1, which implies the uniform 
boundedness of the negative moments 



sup E 

T>0 



\DF T \ 



-P 



< 00 



for any > 0. Fix > 0, and for each T, let i(T) = + lj + \T\. Then, the lower bound 
in (7.14) yields 



(i + l/2)7T 

TB 



> 



> 



i 2 /o 



> 0, 



max 



<r<l 



9{r) 



where in the last inequality we made the substitution r 1 = and set 



g{r) :-- 



y/r(l + r" 2 4^-). 



02 



This implies condition (iii) and the proof of the theorem is complete. 
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8 Appendix 

In this section, we present the omitted proofs and some technical results. 
Proof of Lemma 2.1. Since J^iHv) ~ E[h{N)]}e- y2 '^dy = 0, we have 

POO 

{h(y) - E[h(N)]}e- y2/{2a2) dy = - / {%) - E[h(N)}} e - y2 ^dy. 

) J X 



Hence 



poo 

< / [ay k + b + E \h(N)\]e 

J\x\ 



dy. 



{h(y)-E[h(N)]}e- y /{2a ) dy 
By using the representation (2.18) of fh and Stein's equation (2.15) we have 

{h(y)-E[h(N)]}e-y 2 ^dy 



\f' h (x)\ < \h(x)-E[h(N)]\+ l -§e^^ 



< a\x\ k + b + E\h{N)\ + ^-e x2/{2a2) / y[ay k + b + E \h(N)\] e - y2 ^ dy 

° J\x\ 



a \x\ k + (b + E \h(N)\) 1 + -^sx(x) + -^s k+1 (x 



a' 



a- 



5.1) 



where we let s k {x) = e x2// ^ 2<j2 - ) Jj^ y k e y2 ^ 2a2 ^dy for any integer k > 0. 
Note that E \h(N)\ < aE \N\ k + b< C k aa k + b and 



r°° 2 

Jii(r,„2\ / _v_ 



Sx {x) = e x /{2a } / ye-^^ = a 2 
for all x G R. Using integration by parts, we see by induction that for any integer k > 1, 

hj 



s k+1 (x) = e* 2 '^ I y k ^ 2 l^d l 



\x\ 

POO 

y/i^) / „ k d(-e- y2 /^) = a 2 [\x\ k + ks k . 1 (x)}. 



a e 



y 



\*\ 



\x\ 



Then if k > 1 is even, we have 

k 

s k+ i(x) < C k a 2 [\x\ k + o~ 2 \x\ k ~ 2 + ■■■ + <J k - 2 s x (x)\ < C k a 2 ^ a k ~ l 
If k > 1 is odd, we have 

s fc+ i(x) < C k a 2 [\x\ k + a 2 \x\ k ~ 2 + ■■■ + a k -\\x\ + s (x))] < C k a 2 ^ a k ~' 

i=0 



X\ 



where we used the fact that sq(x) < sq(0) = \J\<y f° r all x G 1R (indeed, when x > we 



have s'o(x) = j^e x ^ 2cr ) f°° e y ^ 2<J ^cfa/ — 1 < ^ 2<T ^ J^ 00 ^-e 2^<i?/ — 1 = 0; similarly when 
x < 0, s' (x) > 0). Putting the above estimates into (8.1) we complete the proof. ■ 
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Proof of Remark 3.5. We shall prove these properties by induction. From 7\ = T 2 = 0, 
(3.17) and (3.19) we know that T 3 = D 2 U 5 U , with J 3 = {(0,0, 1)}; and T 4 = 5 U D 2 J U + Dl6 u , 
with J 4 = {(1, 0, 1, 0), (0, 0, 0, 1)}. Now suppose the statement is true for all 7] with I < k — 1 
for k > 5. We want to prove the multi-indices of T k satisfy (a)-(c). This will be done 
by studying the three operations, 5 u T k _i, D u T k _i and d\Hk-i(D u 5 u , 6 U )D^5 U , in expression 
(3.19). 

For the term d\Hk-i(D u 5 u , 5 U )-D^<5 U , we observe from (3.17) that 

d x H k ^(DJ u , 5 U )D% = D% ick-iA'^&M*' 1 , 

l<i<[(fc-l)/2j 

whose terms have multi-indices (k — 1 — 2i, i — 1, 1, 0, . . . , 0) G N k for 1 < i < [^-\ ■ Then, 
it is straightforward to check that these multi-indices satisfy (a), (b) and (c). 

The term S u T k -i shifts the multi-index (i , i\, . . . , ik-2) G -h-i to (z'o + 1, h, ■ ■ ■ , ik-2, 0) G 
N k , which obviously satisfies (a), (b) and (c), due to the induction hypothesis. 

The third term D u T k _i shifts the multi-index (io, «i, • • • , ik-2) G J k ~\ to either a = (i — 
1, z'x + 1, . . . , i k -2, 0) G N fc if i > 1, or to 

a = |(«o,n, • • • ,ij ~ l,^o+i + 1, • • • , ifc-2, 0), for 1 < jo < k - 3; 
\(io,«i, • • • ,ij ~ 1, 1), for jo = k- 2, 

if ijo — 1- ^ is eas y to criec k that /3 satisfies properties (a), (6) and (c) and a satisfies 
properties (b) and (c). We are left to verify that a satisfies property (c). That is, we want 
to show that 

k- 1 



:*i<L— J- (s- 2 ) 

If k is odd, say fc = 2m+l for some m > 2, (8.2) is true because (io, i±, . . . , ifc_ 2 ) G J^-i, which 
implies by induction hypothesis that X/j=i *j — L^ifJ = m — If & is even, say k = 2m + 2, 



(8.2) is true because the following claim asserts that if io > 1, then JZjLi ij < L^T^J 



m. 



Claim: For (i , ii, . . . , Z2m) G J2m+i with m > 1, if Y^=i ij = m then i = 0. 



Indeed, suppose (io, ii, ■ ■ ■ , i2m) G J2m+i, Y^j=i ij = 171 an d ^0 > 1- We are going to show 
that leads to a contradiction. First notice that i\ > 1, otherwise z'x = and Y^j=2 
which is not possible because 



.r- 



ij = m, 



2m 



io + 2m < io + ^^jij < 2m. 



Also, we must have z' 2m = 0, because otherwise property (a) implies z 2m = 1 and z = 
ii = • • ■ = i2m-\ = 0- Now we trace back to its parent multi-indices in J 2m by reversing 
the three operations. Of the three operations, we can exclude dxH 2m (D u 5 u ,5 u )Dl5 u and 
S u T 2m , because d\H 2m (D u 5 u , 5 u )Dl5 u generates (2m - 2j, j - 1, 1, 0, . . . , 0) with 1 < j < 
m, where j must be m; and 5 u T2 m traces it back to (io — 1, i±, . . . , i 2m -i) G J2m, where 
i\ + • • • + «2m-i = rn > [ 2m 2 ~ 1 j . Therefore, its parent multi-index in J 2m must come from 
the operation D u T 2m and hence must be (i + 1, i\ — 1, . . . , « 2m -i) G J 2m . Note that for this 
multi- index, i\ — 1 + ■ • • + i 2m _i = m — 1. Repeating the above process we will end up at 
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(i + ii, 0, i 2 ■ ■ ■ , «2m-ii) ^ hm+i-h with z 2 + h «2m-ii = m - ii, which contradicts the 

property (6) of J 2m +i-ii because 

2m— ii 

io + 2m — ii < i + H + < 2m — z'i. 

i=2 

■ 

Recall that we denote D df uj- 1 = (Dw^.DF)^ and D k DF w^ = {D(D k DF l w~ l ), DF) fl for 
any k >2. The following lemma estimates the L p (f2) norms of D^piu -1 . 

Lemma 8.1 Lei F = I q (f) with q > 2 satisfying E[F 2 ] = a 2 . For any f3 > 1 we define and 
M P =(E\\DF\\^) 1IP . Setw=\\DF\\l. 

(i) If Mg < oo for some f3 > Q, then for any 1 < r < 

\\DDFur\KCMlWqa 2 -w\\ 2 . (8.3) 

(ii) If k > 2 and Mg < oo /or some /3 > 2k + 4, then for any 1 < r < /j+ ^ +4 

II^df^" 1 !!,. < C {a 2k ~ 2 V 1) (M k+2 V 1) \\qcr 2 - w\\ 2 . (8.4) 

(Hi) If k > land Mp < oo for any f3 > k + 2, then for any 1 < r < 

H^df^IL < C (a 2k V 1) (M^+ 2 V 1) . (8.5) 
Proof. Note that Dopw' 1 = (Div" 1 , DF)^ = -2w~ 2 (D 2 F ^ DF, DF). Then 

\D DF w~ l \ < 2w~% ||D 2 F®! DF| 
Applying Holder's inequality with - = ^ + |, yields 

II^df^ 1 !!, < 2 (£(ur^r)) F ||D 2 F®i DF| 
which implies (8.3) by choosing p < (3/3 and taking into account (4.3). Notice that we need 

1 > I > 1 _|_ 1 _ £+6 
1 — r — /3 ^ 2 2/3 - 

Consider now the case k >2. From the pattern indicated by the first three terms, 
Ddfw- 1 = (Dw-\DF)^ } 

D 2 DF w~ l = (D 2 w-\(DFr 2 )^ 2 + (Dw^^DF,D 2 F)^ 2 , 
D 3 DF w^ = (D 3 w~\(DFf 3 )^. A + 3(D 2 w^ ® DF,D 2 F ® DF)^ 3 

+ (Dw- 1 ® D 2 F, D 2 F <g> Df)^, + (Dw" 1 ® (DF) 02 , D 3 F) 

we can prove by induction that 

fc / k \ 

\D k DpW - i \ < cj2 ll^-V n^ni e n 



2 
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By (2.12), for any p > 1, \\D^F\\ p < C \\F\\ 2 = Co. Applying Holder's inequality and 
assuming that s > r, we have, 



\ d df^-\<cJ2\\\\d^-\^ w DF ^ 



i=l 



a 



k—i 



5.6) 



We are going to see that ||D.F||1 will contribute to compensate the singularity of \\D l w 1 1 
First by induction one can prove that for 1 < % < m, D l w~ x has the following expression 



D'ur 1 = Yl W ' {1+1) 

1=1 (a,/3)e/i,i i=i 



17) 



where J M = {(a, /3) G N 2 ' : a,- + ^ > 3, Y!j=i( a j + = * + 2 0- In fact > for * = 1» 

D-uT 1 = -2w~ 2 D 2 F ®! £>F, 

which is of the above form because J^i = {(1,2), (2, 1)}. Suppose that (8.7) holds for some 
i < m — 1. Then, 

i i 
= ^(-1) ,+1 2(Z + 1) w~ {l+2 \D 2 F®iDF)^{D a ^F®iD^F) 



i=i 



3 = 1 



Et- 1 )' E » 

;=i {oL,0)a u h=i 



(D a >F® l D&F) , 
which is equal to 

i+l ! 

^(-1)' w~^(g)(D a 'F® 1 D^F). 

1=1 i=l 

From (8.7) for any i — 1, . . . , k we can write 

i i 
||^ 1 ||^|| J DF||^<^^ +1 )^ £ JJIIl^FOiDftFll^^.,, (8.8) 

i=l (<x,P)€li,i 3 = 1 

where I M = {(a, ^GN'xN 1 : a,- + > 3, E5=i("i + Pj) = i + 2 0- Note that by (2.12), 

\\D a iF ®! D&F|| < C ||F||* = Ccr 2 

for all p > 1 and all (Xj,/3j. This inequality will be applied to all but one of the contraction 
terms in the product rij = i H-D^F cg>i -D^'FH 8aj+/3j _ 2 . We decompose the sum in (8.8) into 
two parts. If the index I satisfies I < | — 1, then the exponent of w is nonnegative, and the 
p-norm of w can be estimated by a constant times a 2 , while for | — 1 < I this exponent is 
negative. Then, using Holder's inequality and assuming that - = - + i we obtain 



s p 1 2' 



l^-'IU \\ DF \\* 
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< C l {i > 2} (T> 



i-2 



\w 



-(i+iy 



a 2(l~l) \\ D <*i F(8)l D Pi F \ 



1.9) 



KKi 



Note that for I < i < k, I + 1 - f < § + 1. Therefore, for f - 1 < I < i 



w 



Therefore, using (4.3) we obtain 



M 2l+2-i <- M 2l+2-i < M k+2 v 



< C ( (a 2 ^ 2 V l)(M*+ 2 2)p V 1)) ||ga 2 - w\\ 2 



(8.10) 



Combining (8.10) and (8.6) and choosing p such that (k + 2)p < (3 we get (8.4). Note that 
we need 

1 _ k + 2 , 1 _ /3 + 2fc + 4 
2 ~ 



2/3 



which holds if 1 < r < 



2/3 



. The proof of part (iii) is similar and omitted. ■ 
The next lemma gives estimates on D k 5 u for k > 0. 

Lemma 8.2 Let F = I q (f) with q > 2 satisfying E[F 2 } = a 2 . For any (3 > 1 we define 
Mp = (e \\DF\\~/) 1/I3 and denote w = ||£>F|| 2 . 



(i) If Mp < oo for some (3 > 3, then for any 1 < s < |, 

||5«|| s <C(a 2 Vl)(M|vl). 

(m^ If k > 1 and M@ < oo /or some f3 > 3k + 3, i/ien /or any 1 < s < 

\\D%\\ s <C a (M 3 k+3 Vl). 



fs.ir 



(8.12) 



(iii) If k > 2 and Mg < oo /or some /3 > Qk + 6, £aen /or any 1 < s < ^ + 2 ^ +6 , 

MM- < C ff (Mf +3 V l)||ga 2 - w\\ 2 . (8.13) 

Proof. Recall that S u = qFw^ 1 — DofW' 1 . Then for any r > s, 

\\S u \\s < C (o-llu;" 1 !^ + WDdfw^Ws) . 

Then, 1 1 1 1 1 r- = M| r and the result follows by applying Lemma 8.1 (iii) with k — 1 and by 
choosing r < |. 

To show (ii) and (iii) we need to find a useful expression for D k 5 u . Consider the operator 
D u = w~ 1 D£>f- We claim that for any k > 1 the iterated operator .D^ can be expressed as 



i=i ie/i. 



k-l 



i=i 



(8.14) 



48 



where b- Y > are real numbers and 

k-l 

h,k = {i = (io,»i, ••.,«!) : *o > > V j = l,...,Z,^ij = fc}. 
In fact, this is clearly true for k — 1. Assume (8.14) holds for a given fc. Then 



w~ 1 D DF D k u 
k 

^lw- l D DF w- 1 b i 



ie/i, fc 
~k~i 



'k-l 

U D D, 

J=l 



DF 



fc-Z 



z=i 



E^ Vri n 

'k-l 



DF 



'DF 



W 



Shifting the indexes, this can be written as 

A- 



1=1 if 
fe+1 

+E»" E 



'ib+i-i 



'k-l 
J=l 



it; 



DF 



k+l-l 



k+1 

+E»" E »> 

1=2 ieli- hk 

It easy to check that this coincides with 

fc+i 



e^ 1 ^ 1 n vi F w- 1 

h=l j=l,&h 
k+l-l 



DF 



'DF 



W 



J'=l 



DF ■ 



5>-" E <* 



'Jfc+1-2 

n ^ 



DF' 



1=1 ieli, k +i 
Also, note that <5 U = qFw^ 1 + Dfjpiu' 1 and 

= g + qFD DF w~ l + D 2 DF w~ l . 
By induction we can show that for any i > 1 

20 — 1 

= tfu* + q CijD^wD^w- 1 + qFD^w- 1 + D^uT 1 , 
where 5u is the Kronecker symbol. Combining (8.14) and (8.15) we obtain 



i=i iei. 



'k-l 


X 


qfiiio 









(8.15) 
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to— 1 

+q c^D^wD^w" 1 + qFD^w" 1 + D^ + F l w~ l 

3=1 

Next we shall apply Holder's inequality to estimate . Notice that for I = k, i = k > 

2. Therefore, 

k— 1 k—l / \ 

\\D%\\ S < Yl II^'UpII W^DF^h f^o + 1< ^ X +1 pDF^Iro) 

l=i ie/^fe j=i \ _ _*o / 

+C (T ||wr fc || p max |Pcf^ _1 Lo = -Bi + £2, 
i</i<fc+i 

assuming that for Z = 1, . . . , k — 1, - > - + y^Zn — and ->- + —, and where C a denotes a 

o ) i i s p ' z__/j =u r j s p po 

function of cr of the form C(l + <r M ). 

Let us consider first the term Note that if Zq = 1 there is at least one factor of the 
form llD^piu -1 !!^. in the above product, because Y^jZih — k — 1 > 1. Then, we will apply 
the inequality (8.4) to one of these factors and the inequality (8.5) to the remaining ones. 
The estimate (8.5) requires ^- > for j — 1, . . . , k — I and i > ^j^-- On the other hand, 

the estimate (8.4) requires ^- > + ~ for j = 1, . . . , k — I and ^ > + 1. Then, choosing 

p such that 2pl < (3, and taking into account that YljZo ij = k we obtain the inequalities 



1 1 L + 2 i + 3 1 3A; + 3 1 

J>p + EV + — + 2 > — + ~2 



3=1 

Hence, if s < a , W- , a we can write 

fc-1 k-l 

Bx < C a J2K U^K J+2 V l)(^° +3 V l)\\qa 2 - w~% < C.{Mf +3 V l)||ga 2 - w'%. 

1=1 3=1 

For the term B2 we use the estimate (8.4) assuming 2pk < (3 and 

1 1 A; + 3 1 3A; + 3 1 
S > p + — + 2 > — + 2' 

This leads to the same estimate and the proof of (8.13) is complete. To show the estimate 
(8.12) we proceed as before but using the inequality (8.5) for all the factors. In this case the 
summand | does not appear and we obtain (8.12). ■ 
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